Index

A B C D E F G H I J K L M N O P Q R S T U V W X Y _
All Classes and Interfaces|All Packages|Constant Field Values|Serialized Form

A

about(CrawlerConfig) - Static method in class com.norconex.crawler.core.util.About

About - Class in com.norconex.crawler.core.util

About Return Values - Search tag in class com.norconex.importer.handler.ScriptRunner

Section

Absolute date conditions: - Search tag in class com.norconex.importer.handler.condition.impl.DateCondition

Section

Absolute date conditions: - Search tag in class com.norconex.importer.handler.condition.impl.DateConditionConfig

Section

AbstractBatchCommitter<T> - Class in com.norconex.committer.core.batch

A base implementation for doing batch commits.

AbstractBatchCommitter() - Constructor for class com.norconex.committer.core.batch.AbstractBatchCommitter

AbstractCommitter<T> - Class in com.norconex.committer.core

A base implementation taking care of basic plumbing, such as firing main Committer events (including exceptions), storing the Committer context (available via AbstractCommitter.getCommitterContext()), and adding support for filtering unwanted requests.

AbstractCommitter() - Constructor for class com.norconex.committer.core.AbstractCommitter

AbstractDelay - Class in com.norconex.crawler.web.doc.operations.delay.impl

Convenience class to encapsulate various delay strategies.

AbstractDelay() - Constructor for class com.norconex.crawler.web.doc.operations.delay.impl.AbstractDelay

AbstractDelayResolver<T> - Class in com.norconex.crawler.web.doc.operations.delay.impl

Base implementation for creating voluntary delays between URL downloads.

AbstractDelayResolver() - Constructor for class com.norconex.crawler.web.doc.operations.delay.impl.AbstractDelayResolver

AbstractDocumentChecksummer<T> - Class in com.norconex.crawler.core.doc.operations.checksum

Abstract implementation of DocumentChecksummer giving the option to keep the generated checksum in a metadata field.

AbstractDocumentChecksummer() - Constructor for class com.norconex.crawler.core.doc.operations.checksum.AbstractDocumentChecksummer

AbstractDocumentSplitter<T> - Class in com.norconex.importer.handler.splitter

AbstractDocumentSplitter() - Constructor for class com.norconex.importer.handler.splitter.AbstractDocumentSplitter

AbstractFetcher<C> - Class in com.norconex.crawler.core.fetch

Base class implementing the AbstractFetcher.accept(FetchRequest) method using reference filters to determine if this fetcher will accept to fetch a document, in addition to whatever logic implementing classes may provide by optionally overriding AbstractFetcher.acceptRequest(FetchRequest) (which otherwise always return true).

AbstractFetcher() - Constructor for class com.norconex.crawler.core.fetch.AbstractFetcher

AbstractFsCommitter<T,C> - Class in com.norconex.committer.core.fs

Base class for Committers writing to the local file system.

AbstractFsCommitter() - Constructor for class com.norconex.committer.core.fs.AbstractFsCommitter

AbstractImporterStage - Class in com.norconex.crawler.core.doc.pipelines.importer.stages

AbstractImporterStage() - Constructor for class com.norconex.crawler.core.doc.pipelines.importer.stages.AbstractImporterStage

AbstractImporterStage(FetchDirective) - Constructor for class com.norconex.crawler.core.doc.pipelines.importer.stages.AbstractImporterStage

AbstractMetadataChecksummer<T> - Class in com.norconex.crawler.core.doc.operations.checksum

Abstract implementation of MetadataChecksummer giving the option to keep the generated checksum.

AbstractMetadataChecksummer() - Constructor for class com.norconex.crawler.core.doc.operations.checksum.AbstractMetadataChecksummer

AbstractNioFetcher<C> - Class in com.norconex.crawler.fs.fetch.impl

Base class for fetchers relying on Java NIO.2 (java.nio.file), either via the JDK's built-in providers or third-party FileSystemProvider implementations found on the classpath.

AbstractNioFetcher() - Constructor for class com.norconex.crawler.fs.fetch.impl.AbstractNioFetcher

AbstractScreenshotHandler<T> - Class in com.norconex.crawler.web.fetch.util

Base class for screenshot handlers that capture browser page images during crawling.

AbstractScreenshotHandler() - Constructor for class com.norconex.crawler.web.fetch.util.AbstractScreenshotHandler

AbstractScreenshotHandler(CachedStreamFactory) - Constructor for class com.norconex.crawler.web.fetch.util.AbstractScreenshotHandler

accept(CommitterRequest) - Method in class com.norconex.committer.core.AbstractCommitter

accept(CommitterRequest) - Method in interface com.norconex.committer.core.Committer

Gets whether this committer accepts to commit the supplied request.

accept(Event) - Method in class com.norconex.crawler.core.CrawlerCallbacks

Dispatches crawler lifecycle events to the appropriate hook.

accept(Event) - Method in class com.norconex.crawler.core.event.listeners.CrawlerLifeCycleListener

accept(Event) - Method in class com.norconex.crawler.core.event.listeners.DeleteRejectedEventListener

accept(Event) - Method in class com.norconex.crawler.core.event.listeners.StopCrawlerOnMaxEventListener

accept(Event) - Method in class com.norconex.crawler.core.fetch.AbstractFetcher

accept(Event) - Method in class com.norconex.crawler.web.doc.operations.delay.impl.GenericDelayResolver

accept(Event) - Method in class com.norconex.crawler.web.event.listeners.UrlStatusCrawlerEventListener

accept(CommitterPipelineContext) - Method in class com.norconex.crawler.core.doc.pipelines.committer.CommitterPipeline

accept(QueuePipelineContext) - Method in class com.norconex.crawler.core.doc.pipelines.queue.QueuePipeline

accept(FetchRequest) - Method in class com.norconex.crawler.core.fetch.AbstractFetcher

accept(Fetcher, Doc) - Method in interface com.norconex.crawler.core.doc.operations.DocumentConsumer

Processes a document.

accept(Fetcher, Doc) - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolver

accept(FetchRequest) - Method in interface com.norconex.crawler.core.fetch.Fetcher

accept(FetchRequest) - Method in class com.norconex.crawler.core.fetch.MultiFetcher

accept(CrawlerSession) - Method in interface com.norconex.crawler.core.CrawlerCallbacks.CrawlerCommandCallback

accept(CrawlerSession) - Method in class com.norconex.crawler.fs.callbacks.BeforeFsCommand

accept(CrawlerSession, Class<? extends Command>) - Method in interface com.norconex.crawler.core.CrawlerCallbacks.CrawlerCommandCallback

acceptDocument(Doc) - Method in interface com.norconex.crawler.core.doc.operations.filter.DocumentFilter

Whether to accept a document.

acceptDocument(Doc) - Method in class com.norconex.crawler.core.doc.operations.filter.impl.ExtensionReferenceFilter

acceptDocument(Doc) - Method in class com.norconex.crawler.core.doc.operations.filter.impl.GenericMetadataFilter

acceptDocument(Doc) - Method in class com.norconex.crawler.core.doc.operations.filter.impl.GenericReferenceFilter

acceptDocument(Doc) - Method in class com.norconex.crawler.web.doc.operations.filter.impl.SegmentCountUrlFilter

Accepted HTTP methods - Search tag in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcher

Section

acceptMetadata(String, Properties) - Method in class com.norconex.crawler.core.doc.operations.filter.impl.ExtensionReferenceFilter

acceptMetadata(String, Properties) - Method in class com.norconex.crawler.core.doc.operations.filter.impl.GenericMetadataFilter

acceptMetadata(String, Properties) - Method in class com.norconex.crawler.core.doc.operations.filter.impl.GenericReferenceFilter

acceptMetadata(String, Properties) - Method in interface com.norconex.crawler.core.doc.operations.filter.MetadataFilter

Whether to accept the metadata.

acceptMetadata(String, Properties) - Method in class com.norconex.crawler.web.doc.operations.filter.impl.SegmentCountUrlFilter

acceptReference(String) - Method in class com.norconex.crawler.core.doc.operations.filter.impl.ExtensionReferenceFilter

acceptReference(String) - Method in class com.norconex.crawler.core.doc.operations.filter.impl.GenericReferenceFilter

acceptReference(String) - Method in interface com.norconex.crawler.core.doc.operations.filter.ReferenceFilter

Whether to accept this reference.

acceptReference(String) - Method in class com.norconex.crawler.web.doc.operations.filter.impl.SegmentCountUrlFilter

acceptRequest(FetchRequest) - Method in class com.norconex.crawler.core.fetch.AbstractFetcher

Optional method for subclasses to override when in need for additional acceptance logic beyond reference filters (which this abstract class provides).

acceptRequest(FetchRequest) - Method in class com.norconex.crawler.fs.fetch.impl.adlsgen2.AdlsGen2Fetcher

acceptRequest(FetchRequest) - Method in class com.norconex.crawler.fs.fetch.impl.archive.ArchiveFetcher

acceptRequest(FetchRequest) - Method in class com.norconex.crawler.fs.fetch.impl.azureblob.AzureBlobFetcher

acceptRequest(FetchRequest) - Method in class com.norconex.crawler.fs.fetch.impl.box.BoxFetcher

acceptRequest(FetchRequest) - Method in class com.norconex.crawler.fs.fetch.impl.cmis.CmisFetcher

acceptRequest(FetchRequest) - Method in class com.norconex.crawler.fs.fetch.impl.egnyte.EgnyteFetcher

acceptRequest(FetchRequest) - Method in class com.norconex.crawler.fs.fetch.impl.ftp.FtpFetcher

acceptRequest(FetchRequest) - Method in class com.norconex.crawler.fs.fetch.impl.gcs.GcsFetcher

acceptRequest(FetchRequest) - Method in class com.norconex.crawler.fs.fetch.impl.googledrive.GoogleDriveFetcher

acceptRequest(FetchRequest) - Method in class com.norconex.crawler.fs.fetch.impl.hdfs.HdfsFetcher

acceptRequest(FetchRequest) - Method in class com.norconex.crawler.fs.fetch.impl.local.LocalFetcher

acceptRequest(FetchRequest) - Method in class com.norconex.crawler.fs.fetch.impl.m365graph.M365GraphFetcher

acceptRequest(FetchRequest) - Method in class com.norconex.crawler.fs.fetch.impl.s3.S3Fetcher

acceptRequest(FetchRequest) - Method in class com.norconex.crawler.fs.fetch.impl.sftp.SftpFetcher

acceptRequest(FetchRequest) - Method in class com.norconex.crawler.fs.fetch.impl.smb.SmbFetcher

acceptRequest(FetchRequest) - Method in class com.norconex.crawler.fs.fetch.impl.webdav.WebDavFetcher

acceptRequest(FetchRequest) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcher

acceptRequest(FetchRequest) - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcher

acceptRequest(FetchRequest) - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcher

accepts(Collection<T>) - Method in class com.norconex.crawler.core.doc.operations.filter.FilterGroupResolver

Access Control List (ACL) - Search tag in class com.norconex.crawler.fs.fetch.impl.local.LocalFetcher

Section

Access Control List (ACL) - Search tag in class com.norconex.crawler.fs.fetch.impl.smb.SmbFetcher

Section

Accuracy: - Search tag in class com.norconex.importer.handler.transformer.impl.LanguageTransformer

Section

Accuracy: - Search tag in class com.norconex.importer.handler.transformer.impl.LanguageTransformerConfig

Section

ACL - Static variable in class com.norconex.crawler.fs.doc.FsDocMetadata

AclInheritanceMapping() - Constructor for class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.AclInheritanceMapping

AclMapping() - Constructor for class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.AclMapping

ACL mapping - Search tag in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitter

Section

add(String) - Method in interface com.norconex.crawler.core.cluster.CacheSet

add(String) - Method in class com.norconex.crawler.core.cluster.impl.memory.InMemoryCacheSet

add(String) - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheSet

add(T) - Method in interface com.norconex.crawler.core.cluster.CacheQueue

add(T) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastQueueAdapter

add(T) - Method in class com.norconex.crawler.core.cluster.impl.memory.InMemoryCacheQueue

add(T) - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheQueue

ADD_DIRECTORY_TRAILING_SLASH - Enum constant in enum class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizerConfig.Normalization

ADD_DOMAIN_TRAILING_SLASH - Enum constant in enum class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizerConfig.Normalization

ADD_WWW - Enum constant in enum class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizerConfig.Normalization

addAndGet(long) - Method in interface com.norconex.crawler.core.cluster.Counter

addCacheEntryChangeListener(CacheEntryChangeListener<T>, String) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastCacheManager

addCacheEntryChangeListener(CacheEntryChangeListener<T>, String) - Method in interface com.norconex.crawler.core.cluster.CacheManager

Adds a cache entry change listener to the specified cache.

addCacheEntryChangeListener(CacheEntryChangeListener<T>, String) - Method in class com.norconex.crawler.core.cluster.impl.memory.MemoryCacheManager

addCacheEntryChangeListener(CacheEntryChangeListener<T>, String) - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheManager

addCommitter(Committer) - Method in class com.norconex.crawler.core.CrawlerConfig

Adds a Committer responsible for persisting information to a target location/repository.

addCoordinatorChangeListener(CoordinatorChangeListener) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastCluster

addEventListener(EventListener<?>) - Method in class com.norconex.crawler.core.CrawlerConfig

Adds an event listener.

addEventListeners(List<EventListener<?>>) - Method in class com.norconex.crawler.core.CrawlerConfig

Adds event listeners.

addExtractBetween(String, String, boolean) - Method in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractorConfig

Adds patterns delimiting a portion of a document to be considered for link extraction.

addExtractSelectors(List<String>) - Method in class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractorConfig

addExtractSelectors(List<String>) - Method in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractorConfig

Adds selectors matching the portions of a document to be considered for link extraction.

Adding Additional Scripting Languages - Search tag in class com.norconex.importer.handler.ScriptRunner

Section

addLinkSelector(String) - Method in class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractorConfig

Adds a new link selector extracting the "text" from matches.

addLinkSelector(String, String) - Method in class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractorConfig

addLinkTag(String, String) - Method in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractorConfig

addNoExtractBetween(String, String, boolean) - Method in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractorConfig

Adds patterns delimiting a portion of a document to be excluded from link extraction.

addNoExtractSelectors(List<String>) - Method in class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractorConfig

addNoExtractSelectors(List<String>) - Method in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractorConfig

Adds selectors matching the portions of a document to be excluded from link extraction.

addOptionalParameter(String) - Method in class com.norconex.committer.neo4j.Neo4jCommitterConfig

addParentReference(String) - Method in class com.norconex.importer.doc.Doc

addRedirectURL(String) - Method in class com.norconex.crawler.web.ledger.WebCrawlerEntry

Adds a redirect URL to the trail of URLs that were redirected so far.

addRestriction(PropertyMatcher) - Method in class com.norconex.committer.core.BaseCommitterConfig

Adds one restriction this committer should be restricted to.

addRestrictions(List<PropertyMatcher>) - Method in class com.norconex.committer.core.BaseCommitterConfig

Adds restrictions this committer should be restricted to.

addSolrDeleteRequest(UpdateRequest, DeleteRequest) - Method in class com.norconex.committer.solr.SolrCommitter

addSolrUpsertRequest(UpdateRequest, UpsertRequest) - Method in class com.norconex.committer.solr.SolrCommitter

addStep(Step) - Method in class com.norconex.crawler.core.cluster.pipeline.Pipeline

addStepChangeListener(CacheEntryChangeListener<StepRecord>) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.pipeline.HazelcastPipelineManager

Adds a listener that will be triggered with the current step when it changes, regardless of which pipeline it is (most would want to filter on pipeline id).

addStepChangeListener(CacheEntryChangeListener<StepRecord>) - Method in class com.norconex.crawler.core.cluster.impl.memory.LocalPipelineManager

addStepChangeListener(CacheEntryChangeListener<StepRecord>) - Method in interface com.norconex.crawler.core.cluster.pipeline.PipelineManager

Adds a listener for step changes.

addToReferenceTrail(String) - Method in class com.norconex.crawler.core.ledger.CrawlerEntry

Adds original references before normalization, redirect, etc.

addWorkerStatusListener(CacheEntryChangeListener<StepRecord>) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.pipeline.HazelcastPipelineManager

Adds a listener that will be triggered with a worker latest status, whenever it changes for any active workers.

addWorkerStatusListener(CacheEntryChangeListener<StepRecord>) - Method in class com.norconex.crawler.core.cluster.impl.memory.LocalPipelineManager

addWorkerStatusListener(CacheEntryChangeListener<StepRecord>) - Method in interface com.norconex.crawler.core.cluster.pipeline.PipelineManager

Adds a listener for worker status changes.

AdlsGen2Fetcher - Class in com.norconex.crawler.fs.fetch.impl.adlsgen2

Fetcher for Azure Data Lake Storage Gen2, using references such as abfss://filesystem@account.dfs.core.windows.net/path/to/file.

AdlsGen2Fetcher() - Constructor for class com.norconex.crawler.fs.fetch.impl.adlsgen2.AdlsGen2Fetcher

AdlsGen2FetcherConfig - Class in com.norconex.crawler.fs.fetch.impl.adlsgen2

Configuration for AdlsGen2Fetcher.

AdlsGen2FetcherConfig() - Constructor for class com.norconex.crawler.fs.fetch.impl.adlsgen2.AdlsGen2FetcherConfig

ADMIN - Static variable in class com.norconex.crawler.core.cluster.CacheNames

ADMIN_PORT_FILE - Static variable in class com.norconex.crawler.core.cluster.admin.ClusterAdminServer

File name written to the crawler work directory containing the actual admin server port.

afterCommand(BiConsumer<CrawlerSession, Class<? extends Command>>) - Method in class com.norconex.crawler.core.CrawlerCallbacks.CrawlerCallbacksBuilder

Invoked after a command has been executed, but before resources are closed.

afterDocumentFinalizing(BiConsumer<CrawlerSession, Doc>) - Method in class com.norconex.crawler.core.CrawlerCallbacks.CrawlerCallbacksBuilder

afterDocumentProcessing(BiConsumer<CrawlerSession, Doc>) - Method in class com.norconex.crawler.core.CrawlerCallbacks.CrawlerCallbacksBuilder

afterSession(Consumer<CrawlerConfig>) - Method in class com.norconex.crawler.core.CrawlerCallbacks.CrawlerCallbacksBuilder

Invoked after a crawl session has been destroyed and resources closed.

aggregate(FetchRequest, List<FetchResponse>) - Method in interface com.norconex.crawler.core.fetch.MultiFetcher.ResponseAggregator

Aggregate multiple results to produce a single one.

AggregatedFetchResponse - Class in com.norconex.crawler.core.fetch

Holds all responses obtained from fetching a document using one or multiple fetchers.

AggregatedFetchResponse(List<? extends FetchResponse>) - Constructor for class com.norconex.crawler.core.fetch.AggregatedFetchResponse

AggregatedFileFetchResponse - Class in com.norconex.crawler.fs.fetch

File System multi-response information obtained from fetching a document.

AggregatedFileFetchResponse(List<FetchResponse>) - Constructor for class com.norconex.crawler.fs.fetch.AggregatedFileFetchResponse

AggregatedFolderPathsResponse - Class in com.norconex.crawler.fs.fetch

File System multi-response information obtained from fetching a document.

AggregatedFolderPathsResponse(List<FetchResponse>) - Constructor for class com.norconex.crawler.fs.fetch.AggregatedFolderPathsResponse

AggregatedWebFetchResponse - Class in com.norconex.crawler.web.fetch

HTTP Multi-response information obtained from fetching a document.

AggregatedWebFetchResponse(List<FetchResponse>) - Constructor for class com.norconex.crawler.web.fetch.AggregatedWebFetchResponse

all() - Static method in class com.norconex.importer.handler.CommonMatchers

Matches all content types.

ALL - Enum constant in enum class com.norconex.crawler.core.event.listeners.StopCrawlerOnMaxEventListenerConfig.OnMultiple

Stop the crawler when all of the matching event counts have reached the maximum.

allOf(List<CompletableFuture<T>>) - Static method in class com.norconex.crawler.core.util.ConcurrentUtil

Combine a list of CompletableFuture<T> into a single CompletableFuture<List<T>>.

AllOf - Class in com.norconex.importer.handler.condition

AllOf(List<Condition>) - Constructor for class com.norconex.importer.handler.condition.AllOf

allThreadInfos() - Static method in class com.norconex.crawler.core.util.ThreadTracker

allThreadInfos(Predicate<ThreadInfo>) - Static method in class com.norconex.crawler.core.util.ThreadTracker

alpha() - Method in class com.norconex.crawler.core.util.StringSanitizer.Builder

ALWAYS - Enum constant in enum class com.norconex.crawler.web.doc.operations.sitemap.SitemapChangeFrequency

AmazonCloudSearchCommitter - Class in com.norconex.committer.amazoncloudsearch

Commits documents to Amazon CloudSearch.

AmazonCloudSearchCommitter() - Constructor for class com.norconex.committer.amazoncloudsearch.AmazonCloudSearchCommitter

AmazonCloudSearchCommitterConfig - Class in com.norconex.committer.amazoncloudsearch

Commits documents to Amazon CloudSearch.

AmazonCloudSearchCommitterConfig() - Constructor for class com.norconex.committer.amazoncloudsearch.AmazonCloudSearchCommitterConfig

AmazonCloudSearchCommitterPtProvider - Class in com.norconex.committer.amazoncloudsearch.spi

For auto registering in BeanMapper.

AmazonCloudSearchCommitterPtProvider() - Constructor for class com.norconex.committer.amazoncloudsearch.spi.AmazonCloudSearchCommitterPtProvider

analyze(Reader, Properties, String) - Method in class com.norconex.importer.handler.transformer.impl.TextStatisticsTransformer

ANY - Enum constant in enum class com.norconex.crawler.core.event.listeners.StopCrawlerOnMaxEventListenerConfig.OnMultiple

Stop the crawler when any of the matching event count reaches the specified maximum.

AnyOf - Class in com.norconex.importer.handler.condition

AnyOf(List<Condition>) - Constructor for class com.norconex.importer.handler.condition.AnyOf

ApacheHttpUtil - Class in com.norconex.crawler.web.fetch.util

Utility methods for fetcher implementations using Apache HttpClient.

ApacheKafkaCommitter - Class in com.norconex.committer.apachekafka

Commits documents to Kafka via it's Producer API

ApacheKafkaCommitter() - Constructor for class com.norconex.committer.apachekafka.ApacheKafkaCommitter

ApacheKafkaCommitterConfig - Class in com.norconex.committer.apachekafka

Configuration for ApacheKafkaCommitter.

ApacheKafkaCommitterConfig() - Constructor for class com.norconex.committer.apachekafka.ApacheKafkaCommitterConfig

ApacheKafkaCommitterPtProvider - Class in com.norconex.committer.apachekafka.spi

For auto registering in BeanMapper.

ApacheKafkaCommitterPtProvider() - Constructor for class com.norconex.committer.apachekafka.spi.ApacheKafkaCommitterPtProvider

ApacheRedirectCaptureStrategy - Class in com.norconex.crawler.web.fetch.util

This class is used by each crawler instance to capture the closest redirect target whether it is part of a redirect chain or not.

ApacheRedirectCaptureStrategy(RedirectUrlProvider) - Constructor for class com.norconex.crawler.web.fetch.util.ApacheRedirectCaptureStrategy

API_GOOGLE - Static variable in class com.norconex.importer.handler.splitter.impl.TranslatorSplitterConfig

API_LINGO24 - Static variable in class com.norconex.importer.handler.splitter.impl.TranslatorSplitterConfig

API_MICROSOFT - Static variable in class com.norconex.importer.handler.splitter.impl.TranslatorSplitterConfig

API_MOSES - Static variable in class com.norconex.importer.handler.splitter.impl.TranslatorSplitterConfig

API_YANDEX - Static variable in class com.norconex.importer.handler.splitter.impl.TranslatorSplitterConfig

Applicable documents - Search tag in class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractor

Section

Applicable documents - Search tag in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractor

Section

Applicable documents - Search tag in class com.norconex.crawler.web.doc.operations.link.impl.RegexLinkExtractor

Section

Applicable documents - Search tag in class com.norconex.crawler.web.doc.operations.link.impl.XmlFeedLinkExtractor

Section

apply(ImporterPipelineContext) - Method in class com.norconex.crawler.core.doc.pipelines.importer.ImporterPipeline

APPLY_BOTH - Static variable in class com.norconex.importer.handler.transformer.impl.CharacterCaseTransformerConfig

APPLY_FIELD - Static variable in class com.norconex.importer.handler.transformer.impl.CharacterCaseTransformerConfig

APPLY_VALUE - Static variable in class com.norconex.importer.handler.transformer.impl.CharacterCaseTransformerConfig

applyContentTypeAndCharset(String, Doc) - Static method in class com.norconex.crawler.web.fetch.util.ApacheHttpUtil

Applies the Content-Type HTTP response header on the supplied document info.

applyFieldMappings(CommitterRequest) - Method in class com.norconex.committer.core.AbstractCommitter

applyResponseContent(ClassicHttpResponse, Doc) - Static method in class com.norconex.crawler.web.fetch.util.ApacheHttpUtil

Applies the HTTP response content to a document if such content exists.

applyResponseHeaders(HttpResponse, String, Doc, WebCrawlerEntry) - Static method in class com.norconex.crawler.web.fetch.util.ApacheHttpUtil

Applies the HTTP response headers to a document.

applyRotation - Static variable in class com.norconex.importer.handler.parser.impl.OcrConfig.Fields

applyTargetContent(CommitterRequest, String) - Static method in class com.norconex.committer.core.CommitterUtil

Applies the document content (input stream) to the target field name.

applyTargetId(CommitterRequest, String, String) - Static method in class com.norconex.committer.core.CommitterUtil

Applies the source ID field value after extracting it using CommitterUtil.extractSourceIdValue(CommitterRequest, String), to the target ID ID field supplied.

archiveCurrentLedger() - Method in class com.norconex.crawler.core.ledger.CrawlerEntryLedger

Archives the current ledger by making it the baseline and resetting the current ledger to empty.

ArchiveFetcher - Class in com.norconex.crawler.fs.fetch.impl.archive

Fetcher for archive file systems treated as virtual directory trees.

ArchiveFetcher() - Constructor for class com.norconex.crawler.fs.fetch.impl.archive.ArchiveFetcher

ArchiveFetcherConfig - Class in com.norconex.crawler.fs.fetch.impl.archive

Configuration for ArchiveFetcher.

ArchiveFetcherConfig() - Constructor for class com.norconex.crawler.fs.fetch.impl.archive.ArchiveFetcherConfig

Archive files as file systems - Search tag in class com.norconex.crawler.fs.fetch.impl.local.LocalFetcher

Section

ARG_CHECKCFG - Static variable in class com.norconex.importer.ImporterLauncher

ARG_IGNOREERRORS - Static variable in class com.norconex.importer.ImporterLauncher

ARG_VARIABLES - Static variable in class com.norconex.importer.ImporterLauncher

asChunkedText() - Method in class com.norconex.importer.util.WriteAdapter

asChunkedText(FailableBiFunction<Integer, String, Boolean, IOException>) - Method in class com.norconex.importer.util.ReadAdapter

Consumes the source as chunks of text.

asChunkedText(FailableBiFunction<Integer, String, Boolean, IOException>, ReadAdapter.ChunkedReadOptions) - Method in class com.norconex.importer.util.ReadAdapter

asInputStream() - Method in class com.norconex.importer.util.ReadAdapter

asOutputStream() - Method in class com.norconex.importer.util.WriteAdapter

asReader() - Method in class com.norconex.importer.util.ReadAdapter

asReader(Charset) - Method in class com.norconex.importer.util.ReadAdapter

asString() - Method in class com.norconex.importer.util.ReadAdapter

Consumes the input as a string.

asString(Charset) - Method in class com.norconex.importer.util.ReadAdapter

Consumes the input as a string.

asWriter() - Method in class com.norconex.importer.util.WriteAdapter

asWriter(Charset) - Method in class com.norconex.importer.util.WriteAdapter

ASYNCHRONOUS - Enum constant in enum class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.RequestMode

Default mode for content connectors performing full or incremental crawls, offering higher throughput.

authenticateUsingForm(HttpClient) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcher

authenticateUsingForm(HttpClient, HttpAuthConfig) - Static method in class com.norconex.crawler.web.fetch.util.ApacheHttpUtil

Authentication - Search tag in class com.norconex.committer.elasticsearch.ElasticsearchCommitter

Section

Authentication - Search tag in class com.norconex.committer.neo4j.Neo4jCommitter

Section

Authentication - Search tag in class com.norconex.committer.solr.SolrCommitter

Section

Authentication: - Search tag in class com.norconex.committer.amazoncloudsearch.AmazonCloudSearchCommitter

Section

Authentication: - Search tag in class com.norconex.committer.amazoncloudsearch.AmazonCloudSearchCommitterConfig

Section

AUTO - Enum constant in enum class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig.Quality

await(long) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.pipeline.PipelineTerminationTracker

awaitTerminalWorkersReducedStatus() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.pipeline.PipelineCoordinatorState

AzureBlobFetcher - Class in com.norconex.crawler.fs.fetch.impl.azureblob

Fetcher for Azure Blob Storage, using references such as azblob://account/container/path/to/blob.

AzureBlobFetcher() - Constructor for class com.norconex.crawler.fs.fetch.impl.azureblob.AzureBlobFetcher

AzureBlobFetcherConfig - Class in com.norconex.crawler.fs.fetch.impl.azureblob

Configuration for AzureBlobFetcher.

AzureBlobFetcherConfig() - Constructor for class com.norconex.crawler.fs.fetch.impl.azureblob.AzureBlobFetcherConfig

AzureSearchCommitter - Class in com.norconex.committer.azurecognitivesearch

Commits documents to Microsoft Azure Search.

AzureSearchCommitter() - Constructor for class com.norconex.committer.azurecognitivesearch.AzureSearchCommitter

AzureSearchCommitterConfig - Class in com.norconex.committer.azurecognitivesearch

Azure Search Committer configuration.

AzureSearchCommitterConfig() - Constructor for class com.norconex.committer.azurecognitivesearch.AzureSearchCommitterConfig

AzureSearchCommitterPtProvider - Class in com.norconex.committer.azurecognitivesearch.spi

For auto registering in BeanMapper.

AzureSearchCommitterPtProvider() - Constructor for class com.norconex.committer.azurecognitivesearch.spi.AzureSearchCommitterPtProvider

B

BAD_STATUS - Static variable in class com.norconex.crawler.core.ledger.ProcessingOutcome

Bad Documents - Search tag in class com.norconex.crawler.web.WebCrawlerConfig

Section

BASE_PKG - Static variable in class com.norconex.crawler.core.spi.CrawlerCorePtProvider

BASE_PKG - Static variable in class com.norconex.crawler.fs.spi.CrawlerFsPtProvider

BaseAuthNioFetcherConfig - Class in com.norconex.crawler.fs.fetch.impl

Extension of AbstractNioFetcher, adding authentication support.

BaseAuthNioFetcherConfig() - Constructor for class com.norconex.crawler.fs.fetch.impl.BaseAuthNioFetcherConfig

BaseBatchCommitterConfig - Class in com.norconex.committer.core.batch

BaseBatchCommitterConfig() - Constructor for class com.norconex.committer.core.batch.BaseBatchCommitterConfig

BaseChecksummerConfig - Class in com.norconex.crawler.core.doc.operations.checksum

Abstract implementation of MetadataChecksummer giving the option to keep the generated checksum.

BaseChecksummerConfig() - Constructor for class com.norconex.crawler.core.doc.operations.checksum.BaseChecksummerConfig

BaseCommitterConfig - Class in com.norconex.committer.core

A base implementation taking care of basic plumbing for field mappings and restrictions for filtering unwanted requests.

BaseCommitterConfig() - Constructor for class com.norconex.committer.core.BaseCommitterConfig

BaseConditionConfig - Class in com.norconex.importer.handler.condition

Shared base class for condition configuration beans that support an optional user-supplied label.

BaseConditionConfig() - Constructor for class com.norconex.importer.handler.condition.BaseConditionConfig

BaseDelayResolverConfig - Class in com.norconex.crawler.web.doc.operations.delay.impl

Base implementation for creating voluntary delays between URL downloads.

BaseDelayResolverConfig() - Constructor for class com.norconex.crawler.web.doc.operations.delay.impl.BaseDelayResolverConfig

BaseDelayResolverConfig.DelayResolverScope - Enum Class in com.norconex.crawler.web.doc.operations.delay.impl

BaseDocHandlerConfig - Class in com.norconex.importer.handler

Shared base class for document handler configuration beans that support an optional user-supplied label.

BaseDocHandlerConfig() - Constructor for class com.norconex.importer.handler.BaseDocHandlerConfig

BaseDocumentSplitterConfig - Class in com.norconex.importer.handler.splitter

BaseDocumentSplitterConfig() - Constructor for class com.norconex.importer.handler.splitter.BaseDocumentSplitterConfig

BaseFetcherConfig - Class in com.norconex.crawler.core.fetch

Base class implementing the AbstractFetcher.accept(FetchRequest) method using reference filters to determine if this fetcher will accept to fetch a document, in addition to whatever logic implementing classes may provide by optionally overriding AbstractFetcher.acceptRequest(FetchRequest) (which otherwise always return true).

BaseFetcherConfig() - Constructor for class com.norconex.crawler.core.fetch.BaseFetcherConfig

BaseFsCommitterConfig - Class in com.norconex.committer.core.fs

Base class for Committers writing to the local file system.

BaseFsCommitterConfig() - Constructor for class com.norconex.committer.core.fs.BaseFsCommitterConfig

BaseLabelableConfig - Class in com.norconex.importer.handler

Shared base class for importer configuration beans that support an optional user-supplied label.

BaseLabelableConfig() - Constructor for class com.norconex.importer.handler.BaseLabelableConfig

BaseStep - Class in com.norconex.crawler.core.cluster.pipeline

BaseStep(String) - Constructor for class com.norconex.crawler.core.cluster.pipeline.BaseStep

BASIC - Enum constant in enum class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthMethod

BASIC authentication method.

BatchConsumer - Interface in com.norconex.committer.core.batch

Functional interface for processing requests in batch (for committers supporting it).

BatchDispatcher - Class in com.norconex.crawler.core.cmd.crawl.pipeline.process

BatchDispatcher.BatchDispatcherBuilder - Class in com.norconex.crawler.core.cmd.crawl.pipeline.process

beanMapper() - Method in class com.norconex.crawler.core.CrawlerDriver

beanMapper(BeanMapper) - Method in class com.norconex.crawler.core.context.CrawlerContext.Builder

beanMapper(BeanMapper) - Method in class com.norconex.crawler.core.CrawlerDriver.Builder

beforeCommand(BiConsumer<CrawlerSession, Class<? extends Command>>) - Method in class com.norconex.crawler.core.CrawlerCallbacks.CrawlerCallbacksBuilder

Invoked before a command is executed, after the session and crawl context have been initialized.

beforeDocumentFinalizing(BiConsumer<CrawlerSession, Doc>) - Method in class com.norconex.crawler.core.CrawlerCallbacks.CrawlerCallbacksBuilder

beforeDocumentProcessing(BiConsumer<CrawlerSession, Doc>) - Method in class com.norconex.crawler.core.CrawlerCallbacks.CrawlerCallbacksBuilder

BeforeFsCommand - Class in com.norconex.crawler.fs.callbacks

File system crawler-specific initialization before the crawler starts.

BeforeFsCommand() - Constructor for class com.norconex.crawler.fs.callbacks.BeforeFsCommand

beforeSession(Consumer<CrawlerConfig>) - Method in class com.norconex.crawler.core.CrawlerCallbacks.CrawlerCallbacksBuilder

Invoked before the crawl session gets initialized (which is also before any command gets executed).

BinaryContentTransformer - Class in com.norconex.importer.handler.transformer.impl

Captures the document's original, unparsed content and stores it, Base64-encoded, in a metadata field.

BinaryContentTransformer() - Constructor for class com.norconex.importer.handler.transformer.impl.BinaryContentTransformer

BinaryContentTransformerConfig - Class in com.norconex.importer.handler.transformer.impl

BinaryContentTransformer configuration.

BinaryContentTransformerConfig() - Constructor for class com.norconex.importer.handler.transformer.impl.BinaryContentTransformerConfig

bindSession(CrawlerSession) - Method in interface com.norconex.crawler.core.cluster.Cluster

Binds the given crawl session to this cluster node.

bindSession(CrawlerSession) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastCluster

bindSession(CrawlerSession) - Method in class com.norconex.crawler.core.cluster.impl.memory.MemoryCluster

bindSession(CrawlerSession) - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCluster

BlankCondition - Class in com.norconex.importer.handler.condition.impl

A condition based on whether the document content (default) or any of the specified metadata fields are blank or inexistent.

BlankCondition() - Constructor for class com.norconex.importer.handler.condition.impl.BlankCondition

BlankCondition.Fields - Class in com.norconex.importer.handler.condition.impl

BlankConditionConfig - Class in com.norconex.importer.handler.condition.impl

A condition based on whether the document content (default) or any of the specified metadata fields are blank or inexistent.

BlankConditionConfig() - Constructor for class com.norconex.importer.handler.condition.impl.BlankConditionConfig

BOOLEAN - Enum constant in enum class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.StructuredDataType

bootstrap(CrawlerSession) - Method in interface com.norconex.crawler.core.cmd.crawl.pipeline.bootstrap.CrawlerBootstrapper

bootstrap(CrawlerSession) - Method in class com.norconex.crawler.core.cmd.crawl.pipeline.bootstrap.ledger.CrawlerEntryLedgerBootstrapper

bootstrap(CrawlerSession) - Method in class com.norconex.crawler.core.cmd.crawl.pipeline.bootstrap.queue.QueueBootstrapper

BOOTSTRAP_KEY - Static variable in class com.norconex.crawler.core.cmd.crawl.pipeline.bootstrap.ledger.CrawlerEntryLedgerBootstrapper

bootstrapper(CrawlerBootstrapper) - Method in class com.norconex.crawler.core.context.CrawlerContext.Builder

bootstrappers() - Method in class com.norconex.crawler.core.CrawlerDriver

bootstrappers(Collection<? extends CrawlerBootstrapper>) - Method in class com.norconex.crawler.core.context.CrawlerContext.Builder

bootstrappers(List<CrawlerBootstrapper>) - Method in class com.norconex.crawler.core.CrawlerDriver.Builder

BOTH_PERMIT - Enum constant in enum class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.AclInheritanceType

BoxFetcher - Class in com.norconex.crawler.fs.fetch.impl.box

Box API fetcher.

BoxFetcher() - Constructor for class com.norconex.crawler.fs.fetch.impl.box.BoxFetcher

BoxFetcherConfig - Class in com.norconex.crawler.fs.fetch.impl.box

Configuration for BoxFetcher.

BoxFetcherConfig() - Constructor for class com.norconex.crawler.fs.fetch.impl.box.BoxFetcherConfig

browserType(Playwright) - Method in enum class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightBrowser

Returns the Playwright BrowserType for this engine.

BufferUtil - Class in com.norconex.importer.util

Buffer related utility methods.

build() - Method in class com.norconex.committer.core.CommitterContext.Builder

build() - Method in class com.norconex.committer.core.CommitterEvent.CommitterEventBuilder

build() - Method in class com.norconex.committer.core.service.CommitterService.CommitterServiceBuilder

build() - Method in class com.norconex.committer.core.service.CommitterServiceEvent.CommitterServiceEventBuilder

build() - Method in class com.norconex.crawler.core.cluster.admin.ClusterAdminClient.ClusterAdminClientBuilder

build() - Method in class com.norconex.crawler.core.cluster.pipeline.PipelineProgress.PipelineProgressBuilder

build() - Method in class com.norconex.crawler.core.cluster.pipeline.PipelineResult.PipelineResultBuilder

build() - Method in class com.norconex.crawler.core.cmd.crawl.pipeline.process.BatchDispatcher.BatchDispatcherBuilder

build() - Method in class com.norconex.crawler.core.context.CrawlerContext.Builder

build() - Method in class com.norconex.crawler.core.context.CrawlerContextFactory.Builder

build() - Method in class com.norconex.crawler.core.CrawlerCallbacks.CrawlerCallbacksBuilder

build() - Method in class com.norconex.crawler.core.CrawlerDriver.Builder

build() - Method in class com.norconex.crawler.core.doc.CrawlerDocContext.CrawlerDocContextBuilder

build() - Method in class com.norconex.crawler.core.doc.operations.filter.FilterGroupResolver.FilterGroupResolverBuilder

build() - Method in class com.norconex.crawler.core.doc.pipelines.committer.CommitterPipeline.CommitterPipelineBuilder

build() - Method in class com.norconex.crawler.core.doc.pipelines.CrawlerDocPipelines.CrawlerDocPipelinesBuilder

build() - Method in class com.norconex.crawler.core.doc.pipelines.importer.ImporterPipeline.ImporterPipelineBuilder

build() - Method in class com.norconex.crawler.core.doc.pipelines.OnMatchFiltersResolver.OnMatchFiltersResolverBuilder

build() - Method in class com.norconex.crawler.core.doc.pipelines.queue.QueuePipeline.QueuePipelineBuilder

build() - Method in class com.norconex.crawler.core.event.CrawlerEvent.CrawlerEventBuilder

build() - Method in class com.norconex.crawler.core.fetch.MultiFetcher.Builder

build() - Method in class com.norconex.crawler.core.session.CrawlerRunInfo.CrawlerRunInfoBuilder

build() - Method in class com.norconex.crawler.core.util.StringSanitizer.Builder

build() - Method in class com.norconex.crawler.fs.fetch.impl.GenericFileFetchResponse.GenericFileFetchResponseBuilder

build() - Method in class com.norconex.crawler.fs.fetch.impl.GenericFolderPathsFetchResponse.GenericFolderPathsFetchResponseBuilder

build() - Method in class com.norconex.crawler.web.doc.operations.robot.RobotsTxt.RobotsTxtBuilder

build() - Method in class com.norconex.crawler.web.doc.operations.sitemap.SitemapContext.SitemapContextBuilder

build() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetchResponse.HttpClientFetchResponseBuilder

build() - Method in class com.norconex.importer.charset.CharsetDetector.CharsetDetectorBuilder

build() - Method in class com.norconex.importer.handler.DocHandlerContext.DocHandlerContextBuilder

build() - Method in class com.norconex.importer.ImporterEvent.ImporterEventBuilder

build() - Method in class com.norconex.importer.util.chunk.ChunkedTextReader.ChunkedTextReaderBuilder

buildConfig(HazelcastConfigurerContext) - Method in interface com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastConfigurer

Builds a Hazelcast Config for the given context.

buildConfig(HazelcastConfigurerContext) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.JdbcHazelcastConfigurer

buildCustomHttpClient(HttpClientBuilder) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcher

For implementors to subclass.

builder() - Static method in class com.norconex.committer.core.CommitterContext

builder() - Static method in class com.norconex.committer.core.CommitterEvent

builder() - Static method in class com.norconex.committer.core.service.CommitterService

builder() - Static method in class com.norconex.committer.core.service.CommitterServiceEvent

builder() - Static method in class com.norconex.crawler.core.cluster.admin.ClusterAdminClient

builder() - Static method in class com.norconex.crawler.core.cluster.pipeline.PipelineProgress

builder() - Static method in class com.norconex.crawler.core.cluster.pipeline.PipelineResult

builder() - Static method in class com.norconex.crawler.core.cmd.crawl.pipeline.process.BatchDispatcher

builder() - Static method in class com.norconex.crawler.core.context.CrawlerContext

builder() - Static method in class com.norconex.crawler.core.context.CrawlerContextFactory

builder() - Static method in class com.norconex.crawler.core.CrawlerCallbacks

builder() - Static method in class com.norconex.crawler.core.CrawlerDriver

builder() - Static method in class com.norconex.crawler.core.doc.CrawlerDocContext

builder() - Static method in class com.norconex.crawler.core.doc.operations.filter.FilterGroupResolver

builder() - Static method in class com.norconex.crawler.core.doc.pipelines.committer.CommitterPipeline

builder() - Static method in class com.norconex.crawler.core.doc.pipelines.CrawlerDocPipelines

builder() - Static method in class com.norconex.crawler.core.doc.pipelines.importer.ImporterPipeline

builder() - Static method in class com.norconex.crawler.core.doc.pipelines.OnMatchFiltersResolver

builder() - Static method in class com.norconex.crawler.core.doc.pipelines.queue.QueuePipeline

builder() - Static method in class com.norconex.crawler.core.event.CrawlerEvent

builder() - Static method in class com.norconex.crawler.core.fetch.MultiFetcher

builder() - Static method in class com.norconex.crawler.core.session.CrawlerRunInfo

builder() - Static method in class com.norconex.crawler.core.util.StringSanitizer

builder() - Static method in class com.norconex.crawler.fs.fetch.impl.GenericFileFetchResponse

builder() - Static method in class com.norconex.crawler.fs.fetch.impl.GenericFolderPathsFetchResponse

builder() - Static method in class com.norconex.crawler.web.doc.operations.robot.RobotsTxt

builder() - Static method in class com.norconex.crawler.web.doc.operations.sitemap.SitemapContext

builder() - Static method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetchResponse

builder() - Static method in class com.norconex.importer.charset.CharsetDetector

builder() - Static method in class com.norconex.importer.handler.DocHandlerContext

builder() - Static method in class com.norconex.importer.ImporterEvent

builder() - Static method in class com.norconex.importer.util.chunk.ChunkedTextReader

Builder() - Constructor for class com.norconex.crawler.core.context.CrawlerContextFactory.Builder

buildSolrDocument(Properties) - Method in class com.norconex.committer.solr.SolrCommitter

C

"content" field - Search tag in class com.norconex.committer.elasticsearch.ElasticsearchCommitter

Section

CacheEntryChangeListener<T> - Interface in com.norconex.crawler.core.cluster.impl.hazelcast.event

CacheEntryChangeListenerAdapter<T> - Class in com.norconex.crawler.core.cluster.impl.hazelcast.event

Adapter that wraps a CacheEntryChangeListener and implements Hazelcast's entry listener interfaces.

CacheEntryChangeListenerAdapter(CacheEntryChangeListener<T>) - Constructor for class com.norconex.crawler.core.cluster.impl.hazelcast.event.CacheEntryChangeListenerAdapter

cacheExists(String) - Method in interface com.norconex.crawler.core.cluster.CacheManager

cacheExists(String) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastCacheManager

cacheExists(String) - Method in class com.norconex.crawler.core.cluster.impl.memory.MemoryCacheManager

cacheExists(String) - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheManager

CacheKeys - Class in com.norconex.crawler.core.cluster.impl.hazelcast

CacheManager - Interface in com.norconex.crawler.core.cluster

CacheMap<T> - Interface in com.norconex.crawler.core.cluster

CacheNames - Class in com.norconex.crawler.core.cluster

Canonical names for distributed cache maps used by the crawler cluster.

CacheQueue<T> - Interface in com.norconex.crawler.core.cluster

CacheSet - Interface in com.norconex.crawler.core.cluster

cacheTypes() - Method in class com.norconex.crawler.core.CrawlerDriver

Optional map of Hazelcast map-config-name (or wildcard pattern as declared in the YAML, e.g.

cacheTypes(Map<String, Class<?>>) - Method in class com.norconex.crawler.core.context.CrawlerContext.Builder

Map of map-config name/pattern to concrete value type, used to bake the correct (de)serialization class into the config before startup.

cacheTypes(Map<String, Class<?>>) - Method in class com.norconex.crawler.core.CrawlerDriver.Builder

Optional map of Hazelcast map-config-name (or wildcard pattern as declared in the YAML, e.g.

callbacks() - Method in class com.norconex.crawler.core.CrawlerDriver

callbacks(CrawlerCallbacks) - Method in class com.norconex.crawler.core.context.CrawlerContext.Builder

callbacks(CrawlerCallbacks) - Method in class com.norconex.crawler.core.CrawlerDriver.Builder

callWithAutoShutdown(Callable<T>, ExecutorService) - Static method in class com.norconex.crawler.core.util.ConcurrentUtil

canEqual(Object) - Method in class com.norconex.committer.amazoncloudsearch.AmazonCloudSearchCommitter

canEqual(Object) - Method in class com.norconex.committer.amazoncloudsearch.AmazonCloudSearchCommitterConfig

canEqual(Object) - Method in class com.norconex.committer.apachekafka.ApacheKafkaCommitter

canEqual(Object) - Method in class com.norconex.committer.apachekafka.ApacheKafkaCommitterConfig

canEqual(Object) - Method in class com.norconex.committer.azurecognitivesearch.AzureSearchCommitter

canEqual(Object) - Method in class com.norconex.committer.azurecognitivesearch.AzureSearchCommitterConfig

canEqual(Object) - Method in class com.norconex.committer.core.AbstractCommitter

canEqual(Object) - Method in class com.norconex.committer.core.BaseCommitterConfig

canEqual(Object) - Method in class com.norconex.committer.core.batch.AbstractBatchCommitter

canEqual(Object) - Method in class com.norconex.committer.core.batch.BaseBatchCommitterConfig

canEqual(Object) - Method in class com.norconex.committer.core.batch.queue.impl.FsQueue

canEqual(Object) - Method in class com.norconex.committer.core.batch.queue.impl.FsQueueConfig

canEqual(Object) - Method in class com.norconex.committer.core.batch.queue.impl.FsQueueConfig.OnCommitFailure

canEqual(Object) - Method in class com.norconex.committer.core.CommitterEvent

canEqual(Object) - Method in class com.norconex.committer.core.DeleteRequest

canEqual(Object) - Method in class com.norconex.committer.core.fs.AbstractFsCommitter

canEqual(Object) - Method in class com.norconex.committer.core.fs.BaseFsCommitterConfig

canEqual(Object) - Method in class com.norconex.committer.core.fs.impl.CsvColumn

canEqual(Object) - Method in class com.norconex.committer.core.fs.impl.CsvFileCommitter

canEqual(Object) - Method in class com.norconex.committer.core.fs.impl.CsvFileCommitterConfig

canEqual(Object) - Method in class com.norconex.committer.core.fs.impl.JsonFileCommitter

canEqual(Object) - Method in class com.norconex.committer.core.fs.impl.JsonFileCommitterConfig

canEqual(Object) - Method in class com.norconex.committer.core.fs.impl.XmlFileCommitter

canEqual(Object) - Method in class com.norconex.committer.core.fs.impl.XmlFileCommitterConfig

canEqual(Object) - Method in class com.norconex.committer.core.impl.LogCommitter

canEqual(Object) - Method in class com.norconex.committer.core.impl.LogCommitterConfig

canEqual(Object) - Method in class com.norconex.committer.core.impl.MemoryCommitter

canEqual(Object) - Method in class com.norconex.committer.core.impl.MemoryCommitterConfig

canEqual(Object) - Method in class com.norconex.committer.core.service.CommitterService

canEqual(Object) - Method in class com.norconex.committer.core.service.CommitterServiceEvent

canEqual(Object) - Method in class com.norconex.committer.core.UpsertRequest

canEqual(Object) - Method in class com.norconex.committer.elasticsearch.ElasticsearchCommitter

canEqual(Object) - Method in class com.norconex.committer.elasticsearch.ElasticsearchCommitterConfig

canEqual(Object) - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitter

canEqual(Object) - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.AclInheritanceMapping

canEqual(Object) - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.AclMapping

canEqual(Object) - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig

canEqual(Object) - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.MetadataMapping

canEqual(Object) - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.StructuredDataMapping

canEqual(Object) - Method in class com.norconex.committer.idol.IdolCommitter

canEqual(Object) - Method in class com.norconex.committer.idol.IdolCommitterConfig

canEqual(Object) - Method in class com.norconex.committer.neo4j.Neo4jCommitter

canEqual(Object) - Method in class com.norconex.committer.neo4j.Neo4jCommitterConfig

canEqual(Object) - Method in class com.norconex.committer.solr.SolrCommitter

canEqual(Object) - Method in class com.norconex.committer.solr.SolrCommitterConfig

canEqual(Object) - Method in class com.norconex.committer.sql.SqlCommitter

canEqual(Object) - Method in class com.norconex.committer.sql.SqlCommitterConfig

canEqual(Object) - Method in class com.norconex.crawler.core.cli.CliBase

canEqual(Object) - Method in class com.norconex.crawler.core.cli.CliConfigRender

canEqual(Object) - Method in class com.norconex.crawler.core.cli.CliRunner

canEqual(Object) - Method in class com.norconex.crawler.core.cli.CliStart

canEqual(Object) - Method in class com.norconex.crawler.core.cli.CliStop

canEqual(Object) - Method in class com.norconex.crawler.core.cli.CliStoreExport

canEqual(Object) - Method in class com.norconex.crawler.core.cli.CliStoreImport

canEqual(Object) - Method in class com.norconex.crawler.core.cluster.ClusterConfig

canEqual(Object) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastCluster

canEqual(Object) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastClusterConnector

canEqual(Object) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastClusterConnectorConfig

canEqual(Object) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.JdbcHazelcastConfigurer

canEqual(Object) - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreClusterConnector

canEqual(Object) - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreClusterConnectorConfig

canEqual(Object) - Method in class com.norconex.crawler.core.cluster.pipeline.BaseStep

canEqual(Object) - Method in class com.norconex.crawler.core.cluster.pipeline.Pipeline

canEqual(Object) - Method in class com.norconex.crawler.core.cluster.pipeline.Step.StepProgress

canEqual(Object) - Method in class com.norconex.crawler.core.cluster.pipeline.StepRecord

canEqual(Object) - Method in class com.norconex.crawler.core.cluster.QueryFilter

canEqual(Object) - Method in class com.norconex.crawler.core.cluster.SerializedCache.SerializedEntry

canEqual(Object) - Method in class com.norconex.crawler.core.cmd.crawl.CrawlerProgressLogger

canEqual(Object) - Method in class com.norconex.crawler.core.cmd.crawl.pipeline.bootstrap.queue.QueueBootstrapper

canEqual(Object) - Method in class com.norconex.crawler.core.cmd.crawl.pipeline.process.CrawlerProcessStep

canEqual(Object) - Method in class com.norconex.crawler.core.context.CrawlerContext

canEqual(Object) - Method in class com.norconex.crawler.core.context.CrawlerContextFactory.Builder

canEqual(Object) - Method in class com.norconex.crawler.core.CrawlerConfig

canEqual(Object) - Method in class com.norconex.crawler.core.CrawlerDriver.FetchDriver

canEqual(Object) - Method in class com.norconex.crawler.core.doc.operations.checksum.AbstractDocumentChecksummer

canEqual(Object) - Method in class com.norconex.crawler.core.doc.operations.checksum.AbstractMetadataChecksummer

canEqual(Object) - Method in class com.norconex.crawler.core.doc.operations.checksum.BaseChecksummerConfig

canEqual(Object) - Method in class com.norconex.crawler.core.doc.operations.checksum.impl.GenericMetadataChecksummer

canEqual(Object) - Method in class com.norconex.crawler.core.doc.operations.checksum.impl.GenericMetadataChecksummerConfig

canEqual(Object) - Method in class com.norconex.crawler.core.doc.operations.checksum.impl.Md5DocumentChecksummer

canEqual(Object) - Method in class com.norconex.crawler.core.doc.operations.checksum.impl.Md5DocumentChecksummerConfig

canEqual(Object) - Method in class com.norconex.crawler.core.doc.operations.filter.impl.ExtensionReferenceFilter

canEqual(Object) - Method in class com.norconex.crawler.core.doc.operations.filter.impl.ExtensionReferenceFilterConfig

canEqual(Object) - Method in class com.norconex.crawler.core.doc.operations.filter.impl.GenericMetadataFilter

canEqual(Object) - Method in class com.norconex.crawler.core.doc.operations.filter.impl.GenericMetadataFilterConfig

canEqual(Object) - Method in class com.norconex.crawler.core.doc.operations.filter.impl.GenericReferenceFilter

canEqual(Object) - Method in class com.norconex.crawler.core.doc.operations.filter.impl.GenericReferenceFilterConfig

canEqual(Object) - Method in class com.norconex.crawler.core.doc.operations.spoil.impl.GenericSpoiledReferenceStrategizer

canEqual(Object) - Method in class com.norconex.crawler.core.doc.operations.spoil.impl.GenericSpoiledReferenceStrategizerConfig

canEqual(Object) - Method in class com.norconex.crawler.core.doc.pipelines.committer.CommitterPipelineContext

canEqual(Object) - Method in class com.norconex.crawler.core.doc.pipelines.importer.ImporterPipelineContext

canEqual(Object) - Method in class com.norconex.crawler.core.doc.pipelines.queue.QueuePipelineContext

canEqual(Object) - Method in class com.norconex.crawler.core.event.CrawlerEvent

canEqual(Object) - Method in class com.norconex.crawler.core.event.listeners.CrawlerLifeCycleListener

canEqual(Object) - Method in class com.norconex.crawler.core.event.listeners.DeleteRejectedEventListener

canEqual(Object) - Method in class com.norconex.crawler.core.event.listeners.DeleteRejectedEventListenerConfig

canEqual(Object) - Method in class com.norconex.crawler.core.event.listeners.StopCrawlerOnMaxEventListener

canEqual(Object) - Method in class com.norconex.crawler.core.event.listeners.StopCrawlerOnMaxEventListenerConfig

canEqual(Object) - Method in class com.norconex.crawler.core.fetch.AbstractFetcher

canEqual(Object) - Method in class com.norconex.crawler.core.fetch.AggregatedFetchResponse

canEqual(Object) - Method in class com.norconex.crawler.core.fetch.BaseFetcherConfig

canEqual(Object) - Method in class com.norconex.crawler.core.ledger.CrawlerEntry

canEqual(Object) - Method in class com.norconex.crawler.core.ledger.ProcessingOutcome

canEqual(Object) - Method in class com.norconex.crawler.core.session.CrawlerSession.State

canEqual(Object) - Method in class com.norconex.crawler.fs.doc.operations.checksum.FsMetadataChecksummer

canEqual(Object) - Method in class com.norconex.crawler.fs.fetch.AggregatedFileFetchResponse

canEqual(Object) - Method in class com.norconex.crawler.fs.fetch.AggregatedFolderPathsResponse

canEqual(Object) - Method in class com.norconex.crawler.fs.fetch.FileFetchRequest

canEqual(Object) - Method in class com.norconex.crawler.fs.fetch.FolderPathsFetchRequest

canEqual(Object) - Method in class com.norconex.crawler.fs.fetch.FsPath

canEqual(Object) - Method in class com.norconex.crawler.fs.fetch.impl.AbstractNioFetcher

canEqual(Object) - Method in class com.norconex.crawler.fs.fetch.impl.adlsgen2.AdlsGen2Fetcher

canEqual(Object) - Method in class com.norconex.crawler.fs.fetch.impl.adlsgen2.AdlsGen2FetcherConfig

canEqual(Object) - Method in class com.norconex.crawler.fs.fetch.impl.archive.ArchiveFetcher

canEqual(Object) - Method in class com.norconex.crawler.fs.fetch.impl.archive.ArchiveFetcherConfig

canEqual(Object) - Method in class com.norconex.crawler.fs.fetch.impl.azureblob.AzureBlobFetcher

canEqual(Object) - Method in class com.norconex.crawler.fs.fetch.impl.azureblob.AzureBlobFetcherConfig

canEqual(Object) - Method in class com.norconex.crawler.fs.fetch.impl.BaseAuthNioFetcherConfig

canEqual(Object) - Method in class com.norconex.crawler.fs.fetch.impl.box.BoxFetcher

canEqual(Object) - Method in class com.norconex.crawler.fs.fetch.impl.box.BoxFetcherConfig

canEqual(Object) - Method in class com.norconex.crawler.fs.fetch.impl.cmis.CmisAtomSession

canEqual(Object) - Method in class com.norconex.crawler.fs.fetch.impl.cmis.CmisFetcher

canEqual(Object) - Method in class com.norconex.crawler.fs.fetch.impl.cmis.CmisFetcherConfig

canEqual(Object) - Method in class com.norconex.crawler.fs.fetch.impl.egnyte.EgnyteFetcher

canEqual(Object) - Method in class com.norconex.crawler.fs.fetch.impl.egnyte.EgnyteFetcherConfig

canEqual(Object) - Method in class com.norconex.crawler.fs.fetch.impl.ftp.FtpFetcher

canEqual(Object) - Method in class com.norconex.crawler.fs.fetch.impl.ftp.FtpFetcherConfig

canEqual(Object) - Method in class com.norconex.crawler.fs.fetch.impl.gcs.GcsFetcher

canEqual(Object) - Method in class com.norconex.crawler.fs.fetch.impl.gcs.GcsFetcherConfig

canEqual(Object) - Method in class com.norconex.crawler.fs.fetch.impl.GenericFileFetchResponse

canEqual(Object) - Method in class com.norconex.crawler.fs.fetch.impl.GenericFolderPathsFetchResponse

canEqual(Object) - Method in class com.norconex.crawler.fs.fetch.impl.googledrive.GoogleDriveFetcher

canEqual(Object) - Method in class com.norconex.crawler.fs.fetch.impl.googledrive.GoogleDriveFetcherConfig

canEqual(Object) - Method in class com.norconex.crawler.fs.fetch.impl.hdfs.HdfsFetcher

canEqual(Object) - Method in class com.norconex.crawler.fs.fetch.impl.hdfs.HdfsFetcherConfig

canEqual(Object) - Method in class com.norconex.crawler.fs.fetch.impl.hdfs.KerberosConfig

canEqual(Object) - Method in class com.norconex.crawler.fs.fetch.impl.local.LocalFetcher

canEqual(Object) - Method in class com.norconex.crawler.fs.fetch.impl.local.LocalFetcherConfig

canEqual(Object) - Method in class com.norconex.crawler.fs.fetch.impl.m365graph.M365GraphFetcher

canEqual(Object) - Method in class com.norconex.crawler.fs.fetch.impl.m365graph.M365GraphFetcherConfig

canEqual(Object) - Method in class com.norconex.crawler.fs.fetch.impl.s3.S3Fetcher

canEqual(Object) - Method in class com.norconex.crawler.fs.fetch.impl.s3.S3FetcherConfig

canEqual(Object) - Method in class com.norconex.crawler.fs.fetch.impl.sftp.SftpFetcher

canEqual(Object) - Method in class com.norconex.crawler.fs.fetch.impl.sftp.SftpFetcherConfig

canEqual(Object) - Method in class com.norconex.crawler.fs.fetch.impl.smb.SmbFetcher

canEqual(Object) - Method in class com.norconex.crawler.fs.fetch.impl.smb.SmbFetcherConfig

canEqual(Object) - Method in class com.norconex.crawler.fs.fetch.impl.webdav.WebDavFetcher

canEqual(Object) - Method in class com.norconex.crawler.fs.fetch.impl.webdav.WebDavFetcherConfig

canEqual(Object) - Method in class com.norconex.crawler.fs.ledger.FsCrawlerEntry

canEqual(Object) - Method in class com.norconex.crawler.web.doc.operations.canon.impl.GenericCanonicalLinkDetector

canEqual(Object) - Method in class com.norconex.crawler.web.doc.operations.canon.impl.GenericCanonicalLinkDetectorConfig

canEqual(Object) - Method in class com.norconex.crawler.web.doc.operations.checksum.impl.LastModifiedMetadataChecksummer

canEqual(Object) - Method in class com.norconex.crawler.web.doc.operations.delay.impl.AbstractDelay

canEqual(Object) - Method in class com.norconex.crawler.web.doc.operations.delay.impl.AbstractDelayResolver

canEqual(Object) - Method in class com.norconex.crawler.web.doc.operations.delay.impl.BaseDelayResolverConfig

canEqual(Object) - Method in class com.norconex.crawler.web.doc.operations.delay.impl.CrawlerDelay

canEqual(Object) - Method in class com.norconex.crawler.web.doc.operations.delay.impl.DelayRange

canEqual(Object) - Method in class com.norconex.crawler.web.doc.operations.delay.impl.DelayReferencePattern

canEqual(Object) - Method in class com.norconex.crawler.web.doc.operations.delay.impl.DelaySchedule

canEqual(Object) - Method in class com.norconex.crawler.web.doc.operations.delay.impl.GenericDelayResolver

canEqual(Object) - Method in class com.norconex.crawler.web.doc.operations.delay.impl.GenericDelayResolverConfig

canEqual(Object) - Method in class com.norconex.crawler.web.doc.operations.delay.impl.ReferenceDelayResolver

canEqual(Object) - Method in class com.norconex.crawler.web.doc.operations.delay.impl.ReferenceDelayResolverConfig

canEqual(Object) - Method in class com.norconex.crawler.web.doc.operations.delay.impl.SiteDelay

canEqual(Object) - Method in class com.norconex.crawler.web.doc.operations.filter.impl.SegmentCountUrlFilter

canEqual(Object) - Method in class com.norconex.crawler.web.doc.operations.filter.impl.SegmentCountUrlFilterConfig

canEqual(Object) - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImage

canEqual(Object) - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolver

canEqual(Object) - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig

canEqual(Object) - Method in class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractor

canEqual(Object) - Method in class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractorConfig

canEqual(Object) - Method in class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractorConfig.LinkSelector

canEqual(Object) - Method in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractor

canEqual(Object) - Method in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractorConfig

canEqual(Object) - Method in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractorConfig.RegexPair

canEqual(Object) - Method in class com.norconex.crawler.web.doc.operations.link.impl.RegexLinkExtractor

canEqual(Object) - Method in class com.norconex.crawler.web.doc.operations.link.impl.RegexLinkExtractorConfig

canEqual(Object) - Method in class com.norconex.crawler.web.doc.operations.link.impl.RegexLinkExtractorConfig.ExtractionPattern

canEqual(Object) - Method in class com.norconex.crawler.web.doc.operations.link.impl.TikaLinkExtractor

canEqual(Object) - Method in class com.norconex.crawler.web.doc.operations.link.impl.TikaLinkExtractorConfig

canEqual(Object) - Method in class com.norconex.crawler.web.doc.operations.link.impl.XmlFeedLinkExtractor

canEqual(Object) - Method in class com.norconex.crawler.web.doc.operations.link.impl.XmlFeedLinkExtractorConfig

canEqual(Object) - Method in class com.norconex.crawler.web.doc.operations.link.Link

canEqual(Object) - Method in class com.norconex.crawler.web.doc.operations.recrawl.impl.GenericRecrawlableResolver

canEqual(Object) - Method in class com.norconex.crawler.web.doc.operations.recrawl.impl.GenericRecrawlableResolverConfig

canEqual(Object) - Method in class com.norconex.crawler.web.doc.operations.recrawl.impl.GenericRecrawlableResolverConfig.MinFrequency

canEqual(Object) - Method in class com.norconex.crawler.web.doc.operations.robot.impl.StandardRobotsMetaProvider

canEqual(Object) - Method in class com.norconex.crawler.web.doc.operations.robot.impl.StandardRobotsMetaProviderConfig

canEqual(Object) - Method in class com.norconex.crawler.web.doc.operations.robot.impl.StandardRobotsTxtProvider

canEqual(Object) - Method in class com.norconex.crawler.web.doc.operations.robot.RobotsMeta

canEqual(Object) - Method in class com.norconex.crawler.web.doc.operations.robot.RobotsTxt

canEqual(Object) - Method in class com.norconex.crawler.web.doc.operations.scope.impl.GenericUrlScopeResolver

canEqual(Object) - Method in class com.norconex.crawler.web.doc.operations.scope.impl.GenericUrlScopeResolverConfig

canEqual(Object) - Method in class com.norconex.crawler.web.doc.operations.sitemap.impl.GenericSitemapLocator

canEqual(Object) - Method in class com.norconex.crawler.web.doc.operations.sitemap.impl.GenericSitemapLocatorConfig

canEqual(Object) - Method in class com.norconex.crawler.web.doc.operations.sitemap.impl.GenericSitemapResolver

canEqual(Object) - Method in class com.norconex.crawler.web.doc.operations.sitemap.impl.GenericSitemapResolverConfig

canEqual(Object) - Method in class com.norconex.crawler.web.doc.operations.sitemap.SitemapContext

canEqual(Object) - Method in class com.norconex.crawler.web.doc.operations.sitemap.SitemapRecord

canEqual(Object) - Method in class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizer

canEqual(Object) - Method in class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizerConfig

canEqual(Object) - Method in class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizerConfig.NormalizationReplace

canEqual(Object) - Method in class com.norconex.crawler.web.doc.pipelines.importer.WebImporterPipelineContext

canEqual(Object) - Method in class com.norconex.crawler.web.event.listeners.UrlStatusCrawlerEventListener

canEqual(Object) - Method in class com.norconex.crawler.web.event.listeners.UrlStatusCrawlerEventListenerConfig

canEqual(Object) - Method in class com.norconex.crawler.web.fetch.AggregatedWebFetchResponse

canEqual(Object) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthConfig

canEqual(Object) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcher

canEqual(Object) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

canEqual(Object) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetchResponse

canEqual(Object) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.KerberosConfig

canEqual(Object) - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcher

canEqual(Object) - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcherConfig

canEqual(Object) - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightScreenshotHandler

canEqual(Object) - Method in class com.norconex.crawler.web.fetch.impl.webdriver.HttpSniffer

canEqual(Object) - Method in class com.norconex.crawler.web.fetch.impl.webdriver.HttpSnifferConfig

canEqual(Object) - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcher

canEqual(Object) - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig

canEqual(Object) - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverScreenshotHandler

canEqual(Object) - Method in class com.norconex.crawler.web.fetch.util.AbstractScreenshotHandler

canEqual(Object) - Method in class com.norconex.crawler.web.fetch.util.DocImageHandler

canEqual(Object) - Method in class com.norconex.crawler.web.fetch.util.DocImageHandlerConfig

canEqual(Object) - Method in class com.norconex.crawler.web.fetch.util.GenericRedirectUrlProvider

canEqual(Object) - Method in class com.norconex.crawler.web.fetch.util.GenericRedirectUrlProviderConfig

canEqual(Object) - Method in class com.norconex.crawler.web.fetch.util.ScreenshotHandlerConfig

canEqual(Object) - Method in class com.norconex.crawler.web.fetch.WebFetchRequest

canEqual(Object) - Method in class com.norconex.crawler.web.ledger.WebCrawlerEntry

canEqual(Object) - Method in class com.norconex.crawler.web.WebCrawlerConfig

canEqual(Object) - Method in class com.norconex.importer.charset.CharsetDetector.CharsetDetectorBuilder

canEqual(Object) - Method in class com.norconex.importer.doc.Doc

canEqual(Object) - Method in class com.norconex.importer.handler.BaseLabelableConfig

canEqual(Object) - Method in class com.norconex.importer.handler.condition.AllOf

canEqual(Object) - Method in class com.norconex.importer.handler.condition.AnyOf

canEqual(Object) - Method in class com.norconex.importer.handler.condition.ConditionalDocHandler

canEqual(Object) - Method in class com.norconex.importer.handler.condition.ConditionGroup

canEqual(Object) - Method in class com.norconex.importer.handler.condition.impl.BlankCondition

canEqual(Object) - Method in class com.norconex.importer.handler.condition.impl.BlankConditionConfig

canEqual(Object) - Method in class com.norconex.importer.handler.condition.impl.DateCondition

canEqual(Object) - Method in class com.norconex.importer.handler.condition.impl.DateConditionConfig

canEqual(Object) - Method in class com.norconex.importer.handler.condition.impl.DateProviderFactory.DynamicFixedDateTimeProvider

canEqual(Object) - Method in class com.norconex.importer.handler.condition.impl.DateProviderFactory.DynamicFloatingDateTimeProvider

canEqual(Object) - Method in class com.norconex.importer.handler.condition.impl.DateProviderFactory.StaticDateTimeProvider

canEqual(Object) - Method in class com.norconex.importer.handler.condition.impl.DateValueMatcher

canEqual(Object) - Method in class com.norconex.importer.handler.condition.impl.DomCondition

canEqual(Object) - Method in class com.norconex.importer.handler.condition.impl.DomConditionConfig

canEqual(Object) - Method in class com.norconex.importer.handler.condition.impl.NumericCondition

canEqual(Object) - Method in class com.norconex.importer.handler.condition.impl.NumericConditionConfig

canEqual(Object) - Method in class com.norconex.importer.handler.condition.impl.NumericValueMatcher

canEqual(Object) - Method in class com.norconex.importer.handler.condition.impl.ReferenceCondition

canEqual(Object) - Method in class com.norconex.importer.handler.condition.impl.ReferenceConditionConfig

canEqual(Object) - Method in class com.norconex.importer.handler.condition.impl.ScriptCondition

canEqual(Object) - Method in class com.norconex.importer.handler.condition.impl.ScriptConditionConfig

canEqual(Object) - Method in class com.norconex.importer.handler.condition.impl.TextCondition

canEqual(Object) - Method in class com.norconex.importer.handler.condition.impl.TextConditionConfig

canEqual(Object) - Method in class com.norconex.importer.handler.condition.NoneOf

canEqual(Object) - Method in class com.norconex.importer.handler.DocHandlerContext

canEqual(Object) - Method in class com.norconex.importer.handler.parser.impl.DefaultParser

canEqual(Object) - Method in class com.norconex.importer.handler.parser.impl.DefaultParserConfig

canEqual(Object) - Method in class com.norconex.importer.handler.parser.impl.EmbeddedConfig

canEqual(Object) - Method in class com.norconex.importer.handler.parser.impl.ExternalParser

canEqual(Object) - Method in class com.norconex.importer.handler.parser.impl.GrobidConfig

canEqual(Object) - Method in class com.norconex.importer.handler.parser.impl.OcrConfig

canEqual(Object) - Method in class com.norconex.importer.handler.parser.impl.SentimentConfig

canEqual(Object) - Method in class com.norconex.importer.handler.parser.impl.TikaParser

canEqual(Object) - Method in class com.norconex.importer.handler.parser.impl.TikaParserConfig

canEqual(Object) - Method in class com.norconex.importer.handler.Reject

canEqual(Object) - Method in class com.norconex.importer.handler.RejectConfig

canEqual(Object) - Method in class com.norconex.importer.handler.ScriptRunner

canEqual(Object) - Method in class com.norconex.importer.handler.splitter.AbstractDocumentSplitter

canEqual(Object) - Method in class com.norconex.importer.handler.splitter.BaseDocumentSplitterConfig

canEqual(Object) - Method in class com.norconex.importer.handler.splitter.impl.CsvSplitter

canEqual(Object) - Method in class com.norconex.importer.handler.splitter.impl.CsvSplitterConfig

canEqual(Object) - Method in class com.norconex.importer.handler.splitter.impl.DomSplitter

canEqual(Object) - Method in class com.norconex.importer.handler.splitter.impl.DomSplitterConfig

canEqual(Object) - Method in class com.norconex.importer.handler.splitter.impl.PdfPageSplitter

canEqual(Object) - Method in class com.norconex.importer.handler.splitter.impl.PdfPageSplitterConfig

canEqual(Object) - Method in class com.norconex.importer.handler.splitter.impl.TranslatorSplitter

canEqual(Object) - Method in class com.norconex.importer.handler.splitter.impl.TranslatorSplitterConfig

canEqual(Object) - Method in class com.norconex.importer.handler.splitter.impl.XmlStreamSplitter

canEqual(Object) - Method in class com.norconex.importer.handler.splitter.impl.XmlStreamSplitterConfig

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.BinaryContentTransformer

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.BinaryContentTransformerConfig

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.CharacterCaseTransformer

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.CharacterCaseTransformerConfig

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.CharsetTransformer

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.CharsetTransformerConfig

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.CollapseRepeatingTransformer

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.CollapseRepeatingTransformerConfig

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.Constant

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.ConstantTransformer

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.ConstantTransformerConfig

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.CopyTransformer

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.CopyTransformerConfig

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.CountMatchesTransformer

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.CountMatchesTransformerConfig

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.CurrentDateTransformer

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.CurrentDateTransformerConfig

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.DateFormatTransformer

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.DateFormatTransformerConfig

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.DebugTransformer

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.DebugTransformerConfig

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.DeleteTransformer

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.DeleteTransformerConfig

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.DocumentLengthTransformer

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.DocumentLengthTransformerConfig

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.DomOperation

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.DomTransformer

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.DomTransformerConfig

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.ExternalTransformer

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.ExternalTransformerConfig

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.FieldReportTransformer

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.FieldReportTransformerConfig

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.ForceSingleValueTransformer

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.ForceSingleValueTransformerConfig

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.HierarchyOperation

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.HierarchyTransformer

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.HierarchyTransformerConfig

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.ImageTransformer

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.ImageTransformerConfig

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.ImageTransformerConfig.Crop

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.ImageTransformerConfig.Scale

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.KeepOnlyTransformer

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.KeepOnlyTransformerConfig

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.LanguageTransformer

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.LanguageTransformerConfig

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.MergeOperation

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.MergeTransformer

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.MergeTransformerConfig

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.RegexTransformer

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.RegexTransformerConfig

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.RenameOperation

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.RenameTransformer

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.RenameTransformerConfig

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.ReplaceOperation

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.ReplaceTransformer

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.ReplaceTransformerConfig

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.SaveDocumentTransformer

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.SaveDocumentTransformerConfig

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.ScriptTransformer

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.ScriptTransformerConfig

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.SplitOperation

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.SplitTransformer

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.SplitTransformerConfig

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.StripAfterTransformer

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.StripAfterTransformerConfig

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.StripBeforeTransformer

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.StripBeforeTransformerConfig

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.StripBetweenOperation

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.StripBetweenTransformer

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.StripBetweenTransformerConfig

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.SubstringTransformer

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.SubstringTransformerConfig

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.TextBetweenOperation

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.TextBetweenTransformer

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.TextBetweenTransformerConfig

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.TextStatisticsTransformer

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.TextStatisticsTransformerConfig

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.TitleGeneratorTransformer

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.TitleGeneratorTransformerConfig

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.TruncateTransformer

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.TruncateTransformerConfig

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.UrlExtractorTransformer

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.UrlExtractorTransformerConfig

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.UuidTransformer

canEqual(Object) - Method in class com.norconex.importer.handler.transformer.impl.UuidTransformerConfig

canEqual(Object) - Method in class com.norconex.importer.Importer

canEqual(Object) - Method in class com.norconex.importer.ImporterConfig

canEqual(Object) - Method in class com.norconex.importer.ImporterEvent

canEqual(Object) - Method in class com.norconex.importer.ImporterRequest

canEqual(Object) - Method in class com.norconex.importer.response.ImporterResponse

canEqual(Object) - Method in class com.norconex.importer.util.chunk.TextChunk

canEqual(Object) - Method in class com.norconex.importer.util.ReadAdapter.ChunkedReadOptions

canonicalLinkDetector - Static variable in class com.norconex.crawler.web.WebCrawlerConfig.Fields

CanonicalLinkDetector - Interface in com.norconex.crawler.web.doc.operations.canon

Detects and return any canonical URL found in documents, whether from the HTTP headers (metadata), or from a page content (usually HTML).

CanonicalStage - Class in com.norconex.crawler.web.doc.pipelines.importer.stages

Unless we are ignoring canonical URL support, checks that a document is canonical or reject it.

CanonicalStage(FetchDirective) - Constructor for class com.norconex.crawler.web.doc.pipelines.importer.stages.CanonicalStage

captureScreenshotBytes(Page) - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightScreenshotHandler

Captures a screenshot using Playwright's native API.

captureScreenshotBytes(WebDriver) - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverScreenshotHandler

captureScreenshotBytes(T) - Method in class com.norconex.crawler.web.fetch.util.AbstractScreenshotHandler

Captures screenshot bytes for the given browser source.

CASE_LOWER - Static variable in class com.norconex.importer.handler.transformer.impl.CharacterCaseTransformerConfig

CASE_SENTENCES - Static variable in class com.norconex.importer.handler.transformer.impl.CharacterCaseTransformerConfig

CASE_SENTENCES_FULLY - Static variable in class com.norconex.importer.handler.transformer.impl.CharacterCaseTransformerConfig

CASE_STRING - Static variable in class com.norconex.importer.handler.transformer.impl.CharacterCaseTransformerConfig

CASE_STRING_FULLY - Static variable in class com.norconex.importer.handler.transformer.impl.CharacterCaseTransformerConfig

CASE_SWAP - Static variable in class com.norconex.importer.handler.transformer.impl.CharacterCaseTransformerConfig

CASE_UPPER - Static variable in class com.norconex.importer.handler.transformer.impl.CharacterCaseTransformerConfig

CASE_WORDS - Static variable in class com.norconex.importer.handler.transformer.impl.CharacterCaseTransformerConfig

CASE_WORDS_FULLY - Static variable in class com.norconex.importer.handler.transformer.impl.CharacterCaseTransformerConfig

Change Detection (Checksums) - Search tag in class com.norconex.crawler.web.WebCrawlerConfig

Section

changeDiscovery - Static variable in class com.norconex.crawler.core.CrawlerConfig.Fields

CharacterCaseTransformer - Class in com.norconex.importer.handler.transformer.impl

Changes the character case of a document content or matching fields values according to one of the following methods:

CharacterCaseTransformer() - Constructor for class com.norconex.importer.handler.transformer.impl.CharacterCaseTransformer

CharacterCaseTransformerConfig - Class in com.norconex.importer.handler.transformer.impl

Changes the character case of matching fields and values according to one of the following methods:

CharacterCaseTransformerConfig() - Constructor for class com.norconex.importer.handler.transformer.impl.CharacterCaseTransformerConfig

Character encoding - Search tag in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractor

Section

Character encoding - Search tag in class com.norconex.crawler.web.doc.operations.link.impl.RegexLinkExtractor

Section

Character encoding - Search tag in class com.norconex.importer.handler.condition.impl.DomCondition

Section

Character encoding - Search tag in class com.norconex.importer.handler.condition.impl.DomConditionConfig

Section

charset - Static variable in class com.norconex.crawler.core.ledger.CrawlerEntry.Fields

charset() - Method in class com.norconex.importer.handler.DocHandlerContext

charset() - Method in class com.norconex.importer.util.ReadAdapter.ChunkedReadOptions

charset(Charset) - Method in class com.norconex.importer.util.chunk.ChunkedTextReader.ChunkedTextReaderBuilder

charset(Charset) - Method in class com.norconex.importer.util.ReadAdapter.ChunkedReadOptions

CharsetDetector - Class in com.norconex.importer.charset

Character set detector.

CharsetDetector(Charset, Charset, Supplier<Object>) - Constructor for class com.norconex.importer.charset.CharsetDetector

CharsetDetector.CharsetDetectorBuilder - Class in com.norconex.importer.charset

CharsetTransformer - Class in com.norconex.importer.handler.transformer.impl

Transforms a document content (if needed) from a source character encoding (charset) to a target one.

CharsetTransformer() - Constructor for class com.norconex.importer.handler.transformer.impl.CharsetTransformer

CharsetTransformerConfig - Class in com.norconex.importer.handler.transformer.impl

Transforms a document content (if needed) from a source character encoding (charset) to a target one.

CharsetTransformerConfig() - Constructor for class com.norconex.importer.handler.transformer.impl.CharsetTransformerConfig

CharsetUtil - Class in com.norconex.importer.charset

Character set utility methods.

checkAccess(Path, AccessMode...) - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyFileSystemProvider

checkClientTrusted(X509Certificate[], String) - Method in class com.norconex.crawler.web.fetch.util.TrustAllX509TrustManager

checkClientTrusted(X509Certificate[], String, Socket) - Method in class com.norconex.crawler.web.fetch.util.TrustAllX509TrustManager

checkClientTrusted(X509Certificate[], String, SSLEngine) - Method in class com.norconex.crawler.web.fetch.util.TrustAllX509TrustManager

checkServerTrusted(X509Certificate[], String) - Method in class com.norconex.crawler.web.fetch.util.TrustAllX509TrustManager

checkServerTrusted(X509Certificate[], String, Socket) - Method in class com.norconex.crawler.web.fetch.util.TrustAllX509TrustManager

checkServerTrusted(X509Certificate[], String, SSLEngine) - Method in class com.norconex.crawler.web.fetch.util.TrustAllX509TrustManager

CHECKSUM_DOC - Static variable in class com.norconex.crawler.core.doc.CrawlerDocMetaConstants

CHECKSUM_METADATA - Static variable in class com.norconex.crawler.core.doc.CrawlerDocMetaConstants

checksumMD5(InputStream) - Static method in class com.norconex.crawler.core.doc.operations.checksum.ChecksumUtil

checksumMD5(String) - Static method in class com.norconex.crawler.core.doc.operations.checksum.ChecksumUtil

ChecksumStageUtil - Class in com.norconex.crawler.core.doc.pipelines

Checksum stage utility methods.

ChecksumUtil - Class in com.norconex.crawler.core.doc.operations.checksum

Checksum utility methods.

CHILD_OVERRIDE - Enum constant in enum class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.AclInheritanceType

childDocs() - Method in class com.norconex.importer.handler.DocHandlerContext

childPaths(Set<FsPath>) - Method in class com.norconex.crawler.fs.fetch.impl.GenericFolderPathsFetchResponse.GenericFolderPathsFetchResponseBuilder

CHROME - Enum constant in enum class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverBrowser

CHROMIUM - Enum constant in enum class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightBrowser

Chromium-based browser (also used by Google Chrome and Microsoft Edge).

ChunkedReadOptions() - Constructor for class com.norconex.importer.util.ReadAdapter.ChunkedReadOptions

ChunkedTextReader - Class in com.norconex.importer.util.chunk

Supplies chunks of text to the provided consumer.

ChunkedTextReader.ChunkedTextReaderBuilder - Class in com.norconex.importer.util.chunk

ChunkedTextSupport - Interface in com.norconex.importer.util.chunk

ChunkedTextUtil - Class in com.norconex.importer.util.chunk

Utilities when dealing with DocHandlerContext.

CLASSNAME - Enum constant in enum class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcherConfig.WaitElementType

Locate by CSS class name.

CLASSNAME - Enum constant in enum class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig.WaitElementType

clean() - Method in class com.norconex.committer.core.AbstractCommitter

clean() - Method in interface com.norconex.committer.core.batch.queue.CommitterQueue

Cleans any persisted information specific to this queue.

clean() - Method in class com.norconex.committer.core.batch.queue.impl.FsQueue

clean() - Method in interface com.norconex.committer.core.Committer

Cleans any persisted information (e.g. queue) to ensure next run will start fresh.

clean() - Method in class com.norconex.committer.core.service.CommitterService

Cleans all registered committers.

clean() - Method in class com.norconex.crawler.core.Crawler

CleanCommand - Class in com.norconex.crawler.core.cmd.clean

CleanCommand() - Constructor for class com.norconex.crawler.core.cmd.clean.CleanCommand

cleanShutdown(ExecutorService) - Static method in class com.norconex.crawler.core.util.ConcurrentUtil

Shuts down an executor service, handling InterruptedException by interrupting the current thread.

clear() - Method in interface com.norconex.crawler.core.cluster.CacheMap

clear() - Method in interface com.norconex.crawler.core.cluster.CacheQueue

clear() - Method in interface com.norconex.crawler.core.cluster.CacheSet

clear() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastMapAdapter

clear() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastQueueAdapter

clear() - Method in class com.norconex.crawler.core.cluster.impl.memory.InMemoryCacheMap

clear() - Method in class com.norconex.crawler.core.cluster.impl.memory.InMemoryCacheQueue

clear() - Method in class com.norconex.crawler.core.cluster.impl.memory.InMemoryCacheSet

clear() - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheMap

clear() - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheQueue

clear() - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheSet

clearBootstrappers() - Method in class com.norconex.crawler.core.context.CrawlerContext.Builder

clearCache() - Static method in class com.norconex.crawler.web.fetch.util.HstsResolver

clearCaches() - Method in interface com.norconex.crawler.core.cluster.CacheManager

Clears all caches.

clearCaches() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastCacheManager

clearCaches() - Method in class com.norconex.crawler.core.cluster.impl.memory.MemoryCacheManager

clearCaches() - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheManager

clearEventListeners() - Method in class com.norconex.crawler.core.CrawlerConfig

Clears all event listeners.

clearFieldMappings() - Method in class com.norconex.committer.core.BaseCommitterConfig

clearFilters() - Method in class com.norconex.crawler.web.doc.operations.robot.RobotsTxt.RobotsTxtBuilder

clearLinkSelectors() - Method in class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractorConfig

clearLinkTags() - Method in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractorConfig

clearNodeUrls() - Method in class com.norconex.crawler.core.cluster.admin.ClusterAdminClient.ClusterAdminClientBuilder

clearPatterns() - Method in class com.norconex.crawler.web.doc.operations.link.impl.RegexLinkExtractorConfig

clearQueue() - Method in class com.norconex.crawler.core.ledger.CrawlerEntryLedger

clearQueuedEntriesInLedger() - Method in class com.norconex.crawler.core.ledger.CrawlerEntryLedger

Clears QUEUED entries from the active ledger without issuing a physical distributed queue clear.

clearRestrictions() - Method in class com.norconex.committer.core.BaseCommitterConfig

Clears all restrictions.

clearRestrictions() - Method in class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractorConfig

Clears all restrictions.

clearRestrictions() - Method in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractorConfig

Clears all restrictions.

clearRestrictions() - Method in class com.norconex.crawler.web.doc.operations.link.impl.RegexLinkExtractorConfig

Clears all restrictions.

clearRestrictions() - Method in class com.norconex.crawler.web.doc.operations.link.impl.TikaLinkExtractorConfig

Clears all restrictions.

clearRestrictions() - Method in class com.norconex.crawler.web.doc.operations.link.impl.XmlFeedLinkExtractorConfig

Clears all restrictions.

clearSitemapLocations() - Method in class com.norconex.crawler.web.doc.operations.robot.RobotsTxt.RobotsTxtBuilder

clearStages() - Method in class com.norconex.crawler.core.doc.pipelines.committer.CommitterPipeline.CommitterPipelineBuilder

clearStages() - Method in class com.norconex.crawler.core.doc.pipelines.importer.ImporterPipeline.ImporterPipelineBuilder

clearStages() - Method in class com.norconex.crawler.core.doc.pipelines.queue.QueuePipeline.QueuePipelineBuilder

CliBase - Class in com.norconex.crawler.core.cli

Base class for sub-commands.

CliBase() - Constructor for class com.norconex.crawler.core.cli.CliBase

CliClean - Class in com.norconex.crawler.core.cli

Clean the Collector crawling history.

CliClean() - Constructor for class com.norconex.crawler.core.cli.CliClean

CliConfigCheck - Class in com.norconex.crawler.core.cli

Validate configuration file format and quit.

CliConfigCheck() - Constructor for class com.norconex.crawler.core.cli.CliConfigCheck

CliConfigRender - Class in com.norconex.crawler.core.cli

Resolve all includes and variables substitution and print the resulting configuration to facilitate sharing.

CliConfigRender() - Constructor for class com.norconex.crawler.core.cli.CliConfigRender

CliCrawlerLauncher - Class in com.norconex.crawler.core.cli

Launches a crawler command with given crawler specifications and command-line arguments.

CliException - Exception Class in com.norconex.crawler.core.cli

Runtime exception for command line errors.

CliException() - Constructor for exception class com.norconex.crawler.core.cli.CliException

CliException(String) - Constructor for exception class com.norconex.crawler.core.cli.CliException

CliException(String, Throwable) - Constructor for exception class com.norconex.crawler.core.cli.CliException

CliException(Throwable) - Constructor for exception class com.norconex.crawler.core.cli.CliException

CliRunner - Class in com.norconex.crawler.core.cli

Main entry point to the crawler command-line usage.

CliRunner(CrawlerDriver) - Constructor for class com.norconex.crawler.core.cli.CliRunner

CliStart - Class in com.norconex.crawler.core.cli

Start a crawler.

CliStart() - Constructor for class com.norconex.crawler.core.cli.CliStart

CliStop - Class in com.norconex.crawler.core.cli

Stop a crawler.

CliStop() - Constructor for class com.norconex.crawler.core.cli.CliStop

CliStoreExport - Class in com.norconex.crawler.core.cli

Export crawl store to specified file.

CliStoreExport() - Constructor for class com.norconex.crawler.core.cli.CliStoreExport

CliStoreImport - Class in com.norconex.crawler.core.cli

Import crawl store from specified file.

CliStoreImport() - Constructor for class com.norconex.crawler.core.cli.CliStoreImport

close() - Method in class com.norconex.committer.core.AbstractCommitter

close() - Method in interface com.norconex.committer.core.batch.queue.CommitterQueue

close() - Method in class com.norconex.committer.core.batch.queue.impl.FsQueue

close() - Method in interface com.norconex.committer.core.Committer

Close or release any open resources used by this committer.

close() - Method in class com.norconex.committer.core.service.CommitterService

Closes all registered committers.

close() - Method in class com.norconex.crawler.core.cluster.admin.ClusterAdminServer

Stops the HTTP server.

close() - Method in interface com.norconex.crawler.core.cluster.Cluster

close() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastCacheManager

close() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastCluster

close() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastClusterNode

close() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.pipeline.HazelcastPipelineManager

close() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.pipeline.PipelineCoordinator

close() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.pipeline.PipelineCoordinatorState

close() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.pipeline.PipelineExecution

close() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.pipeline.PipelineWorker

close() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.pipeline.PipelineWorkerState

close() - Method in class com.norconex.crawler.core.cluster.impl.memory.MemoryCluster

close() - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheManager

Commits pending changes and closes the MVStore.

close() - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCluster

close() - Method in class com.norconex.crawler.core.context.CrawlerContext

close() - Method in interface com.norconex.crawler.core.metrics.CrawlerMetrics

close() - Method in class com.norconex.crawler.core.metrics.CrawlerMetricsImpl

close() - Method in class com.norconex.crawler.core.session.CrawlerSession

close() - Method in class com.norconex.crawler.fs.fetch.impl.cmis.CmisAtomSession

close() - Method in class com.norconex.importer.doc.Doc

Disposes of any resources associated with this document (like disk or memory cache).

close() - Method in interface com.norconex.importer.handler.DocHandler

Closes any required resources.

close() - Method in class com.norconex.importer.Importer

Closes the importer and its resources.

close(AutoCloseable...) - Static method in class com.norconex.crawler.core.util.ExceptionSwallower

Ensures that any exceptions thrown while closing the supplied resource are swallowed and a default message logged.

close(AutoCloseable, String) - Static method in class com.norconex.crawler.core.util.ExceptionSwallower

Ensures that any exceptions thrown while closing the supplied resource are swallowed and a custom message logged.

closeBatchCommitter() - Method in class com.norconex.committer.amazoncloudsearch.AmazonCloudSearchCommitter

closeBatchCommitter() - Method in class com.norconex.committer.apachekafka.ApacheKafkaCommitter

closeBatchCommitter() - Method in class com.norconex.committer.azurecognitivesearch.AzureSearchCommitter

closeBatchCommitter() - Method in class com.norconex.committer.core.batch.AbstractBatchCommitter

Subclasses can perform additional closing logic by overriding this method.

closeBatchCommitter() - Method in class com.norconex.committer.elasticsearch.ElasticsearchCommitter

closeBatchCommitter() - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitter

closeBatchCommitter() - Method in class com.norconex.committer.neo4j.Neo4jCommitter

closeBatchCommitter() - Method in class com.norconex.committer.solr.SolrCommitter

closeBatchCommitter() - Method in class com.norconex.committer.sql.SqlCommitter

closeDocWriter(EnhancedXmlStreamWriter) - Method in class com.norconex.committer.core.fs.impl.XmlFileCommitter

closeDocWriter(Writer) - Method in class com.norconex.committer.core.fs.impl.JsonFileCommitter

closeDocWriter(CSVPrinter) - Method in class com.norconex.committer.core.fs.impl.CsvFileCommitter

closeDocWriter(T) - Method in class com.norconex.committer.core.fs.AbstractFsCommitter

closeQuietly(AutoCloseable...) - Static method in class com.norconex.crawler.core.util.ExceptionSwallower

Ensures that any exceptions thrown while closing the supplied resource are swallowed and no messages are logged about the exception.

CLOUD - Enum constant in enum class com.norconex.committer.solr.SolrClientType

For use with a SolrCloud cluster.

CloudSearch ID limitations: - Search tag in class com.norconex.committer.amazoncloudsearch.AmazonCloudSearchCommitter

Section

CloudSearch ID limitations: - Search tag in class com.norconex.committer.amazoncloudsearch.AmazonCloudSearchCommitterConfig

Section

Cluster - Interface in com.norconex.crawler.core.cluster

ClusterAdminClient - Class in com.norconex.crawler.core.cluster.admin

ClusterAdminClient.ClusterAdminClientBuilder - Class in com.norconex.crawler.core.cluster.admin

ClusterAdminException - Exception Class in com.norconex.crawler.core.cluster.admin

ClusterAdminException() - Constructor for exception class com.norconex.crawler.core.cluster.admin.ClusterAdminException

ClusterAdminException(String) - Constructor for exception class com.norconex.crawler.core.cluster.admin.ClusterAdminException

ClusterAdminException(String, Throwable) - Constructor for exception class com.norconex.crawler.core.cluster.admin.ClusterAdminException

ClusterAdminException(Throwable) - Constructor for exception class com.norconex.crawler.core.cluster.admin.ClusterAdminException

ClusterAdminServer - Class in com.norconex.crawler.core.cluster.admin

Provides an HTTP admin interface for cluster management.

ClusterAdminServer(CrawlerSession) - Constructor for class com.norconex.crawler.core.cluster.admin.ClusterAdminServer

clusterConfig - Static variable in class com.norconex.crawler.core.CrawlerConfig.Fields

ClusterConfig - Class in com.norconex.crawler.core.cluster

ClusterConfig() - Constructor for class com.norconex.crawler.core.cluster.ClusterConfig

ClusterConnector - Interface in com.norconex.crawler.core.cluster

clustered() - Method in record class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastConfigurerContext

Returns the value of the clustered record component.

ClusterException - Exception Class in com.norconex.crawler.core.cluster

Runtime exception for cache-related errors.

ClusterException() - Constructor for exception class com.norconex.crawler.core.cluster.ClusterException

ClusterException(String) - Constructor for exception class com.norconex.crawler.core.cluster.ClusterException

ClusterException(String, Throwable) - Constructor for exception class com.norconex.crawler.core.cluster.ClusterException

ClusterException(Throwable) - Constructor for exception class com.norconex.crawler.core.cluster.ClusterException

clusterName() - Method in record class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastConfigurerContext

Returns the value of the clusterName record component.

ClusterNode - Interface in com.norconex.crawler.core.cluster

clusterSize() - Method in class com.norconex.crawler.core.cluster.admin.ClusterAdminClient

clusterStop() - Method in class com.norconex.crawler.core.cluster.admin.ClusterAdminClient

CmisAtomSession - Class in com.norconex.crawler.fs.fetch.impl.cmis

CmisAtomSession(CloseableHttpClient) - Constructor for class com.norconex.crawler.fs.fetch.impl.cmis.CmisAtomSession

CmisFetcher - Class in com.norconex.crawler.fs.fetch.impl.cmis

CMIS-enabled Content Management Systems (CMS) fetcher (Atom end-point), backed by a custom, read-only NIO.2 FileSystemProvider (CmisFileSystemProvider).

CmisFetcher() - Constructor for class com.norconex.crawler.fs.fetch.impl.cmis.CmisFetcher

CmisFetcherConfig - Class in com.norconex.crawler.fs.fetch.impl.cmis

Configuration for CmisFetcher.

CmisFetcherConfig() - Constructor for class com.norconex.crawler.fs.fetch.impl.cmis.CmisFetcherConfig

CmisFileAttributes - Class in com.norconex.crawler.fs.fetch.impl.cmis

Attributes of a CMIS object, backed by the Atom "entry" XML document used to derive them.

CmisFileAttributes(Xml) - Constructor for class com.norconex.crawler.fs.fetch.impl.cmis.CmisFileAttributes

CollapseRepeatingTransformer - Class in com.norconex.importer.handler.transformer.impl

Reduces specified consecutive characters or strings to only one instance (document content only).

CollapseRepeatingTransformer() - Constructor for class com.norconex.importer.handler.transformer.impl.CollapseRepeatingTransformer

CollapseRepeatingTransformerConfig - Class in com.norconex.importer.handler.transformer.impl

Reduces specified consecutive characters or strings to only one instance (document content only).

CollapseRepeatingTransformerConfig() - Constructor for class com.norconex.importer.handler.transformer.impl.CollapseRepeatingTransformerConfig

colorSpace - Static variable in class com.norconex.importer.handler.parser.impl.OcrConfig.Fields

columns - Static variable in class com.norconex.committer.core.fs.impl.CsvFileCommitterConfig.Fields

com.norconex.committer.amazoncloudsearch - package com.norconex.committer.amazoncloudsearch

com.norconex.committer.amazoncloudsearch.spi - package com.norconex.committer.amazoncloudsearch.spi

com.norconex.committer.apachekafka - package com.norconex.committer.apachekafka

com.norconex.committer.apachekafka.spi - package com.norconex.committer.apachekafka.spi

com.norconex.committer.azurecognitivesearch - package com.norconex.committer.azurecognitivesearch

com.norconex.committer.azurecognitivesearch.spi - package com.norconex.committer.azurecognitivesearch.spi

com.norconex.committer.core - package com.norconex.committer.core

com.norconex.committer.core.batch - package com.norconex.committer.core.batch

com.norconex.committer.core.batch.queue - package com.norconex.committer.core.batch.queue

com.norconex.committer.core.batch.queue.impl - package com.norconex.committer.core.batch.queue.impl

com.norconex.committer.core.fs - package com.norconex.committer.core.fs

com.norconex.committer.core.fs.impl - package com.norconex.committer.core.fs.impl

com.norconex.committer.core.impl - package com.norconex.committer.core.impl

com.norconex.committer.core.service - package com.norconex.committer.core.service

com.norconex.committer.core.spi - package com.norconex.committer.core.spi

com.norconex.committer.elasticsearch - package com.norconex.committer.elasticsearch

com.norconex.committer.elasticsearch.spi - package com.norconex.committer.elasticsearch.spi

com.norconex.committer.googlecloudsearch - package com.norconex.committer.googlecloudsearch

com.norconex.committer.googlecloudsearch.spi - package com.norconex.committer.googlecloudsearch.spi

com.norconex.committer.idol - package com.norconex.committer.idol

Provides the classes necessary to commit to an IDOL server.

com.norconex.committer.idol.spi - package com.norconex.committer.idol.spi

com.norconex.committer.neo4j - package com.norconex.committer.neo4j

com.norconex.committer.neo4j.spi - package com.norconex.committer.neo4j.spi

com.norconex.committer.solr - package com.norconex.committer.solr

com.norconex.committer.solr.spi - package com.norconex.committer.solr.spi

com.norconex.committer.sql - package com.norconex.committer.sql

com.norconex.committer.sql.spi - package com.norconex.committer.sql.spi

com.norconex.crawler.core - package com.norconex.crawler.core

com.norconex.crawler.core.cli - package com.norconex.crawler.core.cli

com.norconex.crawler.core.cluster - package com.norconex.crawler.core.cluster

com.norconex.crawler.core.cluster.admin - package com.norconex.crawler.core.cluster.admin

com.norconex.crawler.core.cluster.impl.hazelcast - package com.norconex.crawler.core.cluster.impl.hazelcast

com.norconex.crawler.core.cluster.impl.hazelcast.event - package com.norconex.crawler.core.cluster.impl.hazelcast.event

com.norconex.crawler.core.cluster.impl.hazelcast.jdbc - package com.norconex.crawler.core.cluster.impl.hazelcast.jdbc

com.norconex.crawler.core.cluster.impl.hazelcast.pipeline - package com.norconex.crawler.core.cluster.impl.hazelcast.pipeline

com.norconex.crawler.core.cluster.impl.memory - package com.norconex.crawler.core.cluster.impl.memory

com.norconex.crawler.core.cluster.impl.mvstore - package com.norconex.crawler.core.cluster.impl.mvstore

com.norconex.crawler.core.cluster.pipeline - package com.norconex.crawler.core.cluster.pipeline

com.norconex.crawler.core.cmd - package com.norconex.crawler.core.cmd

com.norconex.crawler.core.cmd.clean - package com.norconex.crawler.core.cmd.clean

com.norconex.crawler.core.cmd.crawl - package com.norconex.crawler.core.cmd.crawl

com.norconex.crawler.core.cmd.crawl.pipeline - package com.norconex.crawler.core.cmd.crawl.pipeline

com.norconex.crawler.core.cmd.crawl.pipeline.bootstrap - package com.norconex.crawler.core.cmd.crawl.pipeline.bootstrap

com.norconex.crawler.core.cmd.crawl.pipeline.bootstrap.ledger - package com.norconex.crawler.core.cmd.crawl.pipeline.bootstrap.ledger

com.norconex.crawler.core.cmd.crawl.pipeline.bootstrap.queue - package com.norconex.crawler.core.cmd.crawl.pipeline.bootstrap.queue

com.norconex.crawler.core.cmd.crawl.pipeline.orphans - package com.norconex.crawler.core.cmd.crawl.pipeline.orphans

com.norconex.crawler.core.cmd.crawl.pipeline.process - package com.norconex.crawler.core.cmd.crawl.pipeline.process

com.norconex.crawler.core.cmd.stop - package com.norconex.crawler.core.cmd.stop

com.norconex.crawler.core.cmd.storeexport - package com.norconex.crawler.core.cmd.storeexport

com.norconex.crawler.core.cmd.storeimport - package com.norconex.crawler.core.cmd.storeimport

com.norconex.crawler.core.context - package com.norconex.crawler.core.context

com.norconex.crawler.core.doc - package com.norconex.crawler.core.doc

com.norconex.crawler.core.doc.operations - package com.norconex.crawler.core.doc.operations

com.norconex.crawler.core.doc.operations.checksum - package com.norconex.crawler.core.doc.operations.checksum

com.norconex.crawler.core.doc.operations.checksum.impl - package com.norconex.crawler.core.doc.operations.checksum.impl

com.norconex.crawler.core.doc.operations.filter - package com.norconex.crawler.core.doc.operations.filter

com.norconex.crawler.core.doc.operations.filter.impl - package com.norconex.crawler.core.doc.operations.filter.impl

com.norconex.crawler.core.doc.operations.spoil - package com.norconex.crawler.core.doc.operations.spoil

com.norconex.crawler.core.doc.operations.spoil.impl - package com.norconex.crawler.core.doc.operations.spoil.impl

com.norconex.crawler.core.doc.pipelines - package com.norconex.crawler.core.doc.pipelines

com.norconex.crawler.core.doc.pipelines.committer - package com.norconex.crawler.core.doc.pipelines.committer

com.norconex.crawler.core.doc.pipelines.committer.stages - package com.norconex.crawler.core.doc.pipelines.committer.stages

com.norconex.crawler.core.doc.pipelines.importer - package com.norconex.crawler.core.doc.pipelines.importer

com.norconex.crawler.core.doc.pipelines.importer.stages - package com.norconex.crawler.core.doc.pipelines.importer.stages

com.norconex.crawler.core.doc.pipelines.queue - package com.norconex.crawler.core.doc.pipelines.queue

com.norconex.crawler.core.doc.pipelines.queue.stages - package com.norconex.crawler.core.doc.pipelines.queue.stages

com.norconex.crawler.core.event - package com.norconex.crawler.core.event

com.norconex.crawler.core.event.listeners - package com.norconex.crawler.core.event.listeners

com.norconex.crawler.core.fetch - package com.norconex.crawler.core.fetch

com.norconex.crawler.core.ledger - package com.norconex.crawler.core.ledger

com.norconex.crawler.core.metrics - package com.norconex.crawler.core.metrics

com.norconex.crawler.core.session - package com.norconex.crawler.core.session

com.norconex.crawler.core.spi - package com.norconex.crawler.core.spi

com.norconex.crawler.core.util - package com.norconex.crawler.core.util

com.norconex.crawler.fs - package com.norconex.crawler.fs

com.norconex.crawler.fs.callbacks - package com.norconex.crawler.fs.callbacks

com.norconex.crawler.fs.doc - package com.norconex.crawler.fs.doc

com.norconex.crawler.fs.doc.operations.checksum - package com.norconex.crawler.fs.doc.operations.checksum

com.norconex.crawler.fs.doc.pipelines - package com.norconex.crawler.fs.doc.pipelines

com.norconex.crawler.fs.doc.pipelines.importer.stages - package com.norconex.crawler.fs.doc.pipelines.importer.stages

com.norconex.crawler.fs.fetch - package com.norconex.crawler.fs.fetch

com.norconex.crawler.fs.fetch.impl - package com.norconex.crawler.fs.fetch.impl

com.norconex.crawler.fs.fetch.impl.adlsgen2 - package com.norconex.crawler.fs.fetch.impl.adlsgen2

com.norconex.crawler.fs.fetch.impl.archive - package com.norconex.crawler.fs.fetch.impl.archive

com.norconex.crawler.fs.fetch.impl.azureblob - package com.norconex.crawler.fs.fetch.impl.azureblob

com.norconex.crawler.fs.fetch.impl.box - package com.norconex.crawler.fs.fetch.impl.box

com.norconex.crawler.fs.fetch.impl.cmis - package com.norconex.crawler.fs.fetch.impl.cmis

com.norconex.crawler.fs.fetch.impl.egnyte - package com.norconex.crawler.fs.fetch.impl.egnyte

com.norconex.crawler.fs.fetch.impl.ftp - package com.norconex.crawler.fs.fetch.impl.ftp

com.norconex.crawler.fs.fetch.impl.gcs - package com.norconex.crawler.fs.fetch.impl.gcs

com.norconex.crawler.fs.fetch.impl.googledrive - package com.norconex.crawler.fs.fetch.impl.googledrive

com.norconex.crawler.fs.fetch.impl.hdfs - package com.norconex.crawler.fs.fetch.impl.hdfs

com.norconex.crawler.fs.fetch.impl.local - package com.norconex.crawler.fs.fetch.impl.local

com.norconex.crawler.fs.fetch.impl.m365graph - package com.norconex.crawler.fs.fetch.impl.m365graph

com.norconex.crawler.fs.fetch.impl.s3 - package com.norconex.crawler.fs.fetch.impl.s3

com.norconex.crawler.fs.fetch.impl.sftp - package com.norconex.crawler.fs.fetch.impl.sftp

com.norconex.crawler.fs.fetch.impl.smb - package com.norconex.crawler.fs.fetch.impl.smb

com.norconex.crawler.fs.fetch.impl.webdav - package com.norconex.crawler.fs.fetch.impl.webdav

com.norconex.crawler.fs.ledger - package com.norconex.crawler.fs.ledger

com.norconex.crawler.fs.spi - package com.norconex.crawler.fs.spi

com.norconex.crawler.web - package com.norconex.crawler.web

com.norconex.crawler.web.callbacks - package com.norconex.crawler.web.callbacks

com.norconex.crawler.web.doc - package com.norconex.crawler.web.doc

com.norconex.crawler.web.doc.operations.canon - package com.norconex.crawler.web.doc.operations.canon

com.norconex.crawler.web.doc.operations.canon.impl - package com.norconex.crawler.web.doc.operations.canon.impl

com.norconex.crawler.web.doc.operations.checksum.impl - package com.norconex.crawler.web.doc.operations.checksum.impl

com.norconex.crawler.web.doc.operations.delay - package com.norconex.crawler.web.doc.operations.delay

com.norconex.crawler.web.doc.operations.delay.impl - package com.norconex.crawler.web.doc.operations.delay.impl

com.norconex.crawler.web.doc.operations.filter.impl - package com.norconex.crawler.web.doc.operations.filter.impl

com.norconex.crawler.web.doc.operations.image.impl - package com.norconex.crawler.web.doc.operations.image.impl

com.norconex.crawler.web.doc.operations.link - package com.norconex.crawler.web.doc.operations.link

com.norconex.crawler.web.doc.operations.link.impl - package com.norconex.crawler.web.doc.operations.link.impl

com.norconex.crawler.web.doc.operations.recrawl - package com.norconex.crawler.web.doc.operations.recrawl

com.norconex.crawler.web.doc.operations.recrawl.impl - package com.norconex.crawler.web.doc.operations.recrawl.impl

com.norconex.crawler.web.doc.operations.robot - package com.norconex.crawler.web.doc.operations.robot

com.norconex.crawler.web.doc.operations.robot.impl - package com.norconex.crawler.web.doc.operations.robot.impl

com.norconex.crawler.web.doc.operations.scope - package com.norconex.crawler.web.doc.operations.scope

com.norconex.crawler.web.doc.operations.scope.impl - package com.norconex.crawler.web.doc.operations.scope.impl

com.norconex.crawler.web.doc.operations.sitemap - package com.norconex.crawler.web.doc.operations.sitemap

com.norconex.crawler.web.doc.operations.sitemap.impl - package com.norconex.crawler.web.doc.operations.sitemap.impl

com.norconex.crawler.web.doc.operations.url - package com.norconex.crawler.web.doc.operations.url

com.norconex.crawler.web.doc.operations.url.impl - package com.norconex.crawler.web.doc.operations.url.impl

com.norconex.crawler.web.doc.pipelines - package com.norconex.crawler.web.doc.pipelines

com.norconex.crawler.web.doc.pipelines.committer.stages - package com.norconex.crawler.web.doc.pipelines.committer.stages

com.norconex.crawler.web.doc.pipelines.importer - package com.norconex.crawler.web.doc.pipelines.importer

com.norconex.crawler.web.doc.pipelines.importer.stages - package com.norconex.crawler.web.doc.pipelines.importer.stages

com.norconex.crawler.web.doc.pipelines.queue - package com.norconex.crawler.web.doc.pipelines.queue

com.norconex.crawler.web.doc.pipelines.queue.stages - package com.norconex.crawler.web.doc.pipelines.queue.stages

com.norconex.crawler.web.event - package com.norconex.crawler.web.event

com.norconex.crawler.web.event.listeners - package com.norconex.crawler.web.event.listeners

com.norconex.crawler.web.fetch - package com.norconex.crawler.web.fetch

com.norconex.crawler.web.fetch.impl.httpclient - package com.norconex.crawler.web.fetch.impl.httpclient

com.norconex.crawler.web.fetch.impl.playwright - package com.norconex.crawler.web.fetch.impl.playwright

com.norconex.crawler.web.fetch.impl.webdriver - package com.norconex.crawler.web.fetch.impl.webdriver

com.norconex.crawler.web.fetch.util - package com.norconex.crawler.web.fetch.util

com.norconex.crawler.web.ledger - package com.norconex.crawler.web.ledger

com.norconex.crawler.web.spi - package com.norconex.crawler.web.spi

com.norconex.crawler.web.util - package com.norconex.crawler.web.util

com.norconex.importer - package com.norconex.importer

com.norconex.importer.charset - package com.norconex.importer.charset

com.norconex.importer.doc - package com.norconex.importer.doc

com.norconex.importer.handler - package com.norconex.importer.handler

com.norconex.importer.handler.condition - package com.norconex.importer.handler.condition

com.norconex.importer.handler.condition.impl - package com.norconex.importer.handler.condition.impl

com.norconex.importer.handler.parser - package com.norconex.importer.handler.parser

com.norconex.importer.handler.parser.impl - package com.norconex.importer.handler.parser.impl

com.norconex.importer.handler.splitter - package com.norconex.importer.handler.splitter

com.norconex.importer.handler.splitter.impl - package com.norconex.importer.handler.splitter.impl

com.norconex.importer.handler.transformer.impl - package com.norconex.importer.handler.transformer.impl

com.norconex.importer.response - package com.norconex.importer.response

com.norconex.importer.spi - package com.norconex.importer.spi

com.norconex.importer.util - package com.norconex.importer.util

com.norconex.importer.util.chunk - package com.norconex.importer.util.chunk

Combining events - Search tag in class com.norconex.crawler.core.event.listeners.StopCrawlerOnMaxEventListener

Section

Command - Interface in com.norconex.crawler.core.cmd

A crawler command launched within an active crawl session.

commandClass(Class<? extends Command>) - Method in class com.norconex.crawler.core.event.CrawlerEvent.CrawlerEventBuilder

The command class firing a CrawlerEvent.CRAWLER_COMMAND_BEGIN or CrawlerEvent.CRAWLER_COMMAND_END event, or null for all other events.

commitBatch(Iterator<CommitterRequest>) - Method in class com.norconex.committer.amazoncloudsearch.AmazonCloudSearchCommitter

commitBatch(Iterator<CommitterRequest>) - Method in class com.norconex.committer.apachekafka.ApacheKafkaCommitter

commitBatch(Iterator<CommitterRequest>) - Method in class com.norconex.committer.azurecognitivesearch.AzureSearchCommitter

commitBatch(Iterator<CommitterRequest>) - Method in class com.norconex.committer.core.batch.AbstractBatchCommitter

Commits the supplied batch.

commitBatch(Iterator<CommitterRequest>) - Method in class com.norconex.committer.elasticsearch.ElasticsearchCommitter

commitBatch(Iterator<CommitterRequest>) - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitter

commitBatch(Iterator<CommitterRequest>) - Method in class com.norconex.committer.idol.IdolCommitter

commitBatch(Iterator<CommitterRequest>) - Method in class com.norconex.committer.neo4j.Neo4jCommitter

commitBatch(Iterator<CommitterRequest>) - Method in class com.norconex.committer.solr.SolrCommitter

commitBatch(Iterator<CommitterRequest>) - Method in class com.norconex.committer.sql.SqlCommitter

CommitModuleStage - Class in com.norconex.crawler.core.doc.pipelines.committer.stages

Common pipeline stage for committing documents.

CommitModuleStage() - Constructor for class com.norconex.crawler.core.doc.pipelines.committer.stages.CommitModuleStage

Committer - Interface in com.norconex.committer.core

Commits documents to their final destination (e.g. search engine).

COMMITTER_ACCEPT_ERROR - Static variable in class com.norconex.committer.core.CommitterEvent

The Committer acceptance check produced an error.

COMMITTER_ACCEPT_NO - Static variable in class com.norconex.committer.core.CommitterEvent

The Committer has rejected a request and it will not commit it.

COMMITTER_ACCEPT_YES - Static variable in class com.norconex.committer.core.CommitterEvent

The Committer has accepted a request and it will commit it.

COMMITTER_BATCH_BEGIN - Static variable in class com.norconex.committer.core.CommitterEvent

The Committer is about to commit a request batch.

COMMITTER_BATCH_END - Static variable in class com.norconex.committer.core.CommitterEvent

The Committer is done committing a request batch Triggered by supporting Committers only.

COMMITTER_BATCH_ERROR - Static variable in class com.norconex.committer.core.CommitterEvent

The Committer encountered an error when committing a request batch.

COMMITTER_CLEAN_BEGIN - Static variable in class com.norconex.committer.core.CommitterEvent

The Committer is being cleaned.

COMMITTER_CLEAN_END - Static variable in class com.norconex.committer.core.CommitterEvent

The Committer has been cleaned.

COMMITTER_CLEAN_ERROR - Static variable in class com.norconex.committer.core.CommitterEvent

The Committer encountered an error when cleaning.

COMMITTER_CLOSE_BEGIN - Static variable in class com.norconex.committer.core.CommitterEvent

The Committer is closing.

COMMITTER_CLOSE_END - Static variable in class com.norconex.committer.core.CommitterEvent

The Committer is closed.

COMMITTER_CLOSE_ERROR - Static variable in class com.norconex.committer.core.CommitterEvent

The Committer encountered an error when closing.

COMMITTER_DELETE_BEGIN - Static variable in class com.norconex.committer.core.CommitterEvent

The Committer is receiving document to be removed.

COMMITTER_DELETE_END - Static variable in class com.norconex.committer.core.CommitterEvent

The Committer has received a document to be removed.

COMMITTER_DELETE_ERROR - Static variable in class com.norconex.committer.core.CommitterEvent

The Committer entity removal produced an error.

COMMITTER_INIT_BEGIN - Static variable in class com.norconex.committer.core.CommitterEvent

The Committer began its initialization.

COMMITTER_INIT_END - Static variable in class com.norconex.committer.core.CommitterEvent

The Committer has been initialized.

COMMITTER_INIT_ERROR - Static variable in class com.norconex.committer.core.CommitterEvent

The Committer encountered an error when initializing.

COMMITTER_SERVICE_CLEAN_BEGIN - Static variable in class com.norconex.committer.core.service.CommitterServiceEvent

COMMITTER_SERVICE_CLEAN_END - Static variable in class com.norconex.committer.core.service.CommitterServiceEvent

COMMITTER_SERVICE_CLOSE_BEGIN - Static variable in class com.norconex.committer.core.service.CommitterServiceEvent

COMMITTER_SERVICE_CLOSE_END - Static variable in class com.norconex.committer.core.service.CommitterServiceEvent

COMMITTER_SERVICE_DELETE_BEGIN - Static variable in class com.norconex.committer.core.service.CommitterServiceEvent

COMMITTER_SERVICE_DELETE_END - Static variable in class com.norconex.committer.core.service.CommitterServiceEvent

COMMITTER_SERVICE_INIT_BEGIN - Static variable in class com.norconex.committer.core.service.CommitterServiceEvent

COMMITTER_SERVICE_INIT_END - Static variable in class com.norconex.committer.core.service.CommitterServiceEvent

COMMITTER_SERVICE_UPSERT_BEGIN - Static variable in class com.norconex.committer.core.service.CommitterServiceEvent

COMMITTER_SERVICE_UPSERT_END - Static variable in class com.norconex.committer.core.service.CommitterServiceEvent

COMMITTER_UPSERT_BEGIN - Static variable in class com.norconex.committer.core.CommitterEvent

The Committer is receiving a document to be updated or inserted.

COMMITTER_UPSERT_END - Static variable in class com.norconex.committer.core.CommitterEvent

The Committer has received a document to be updated or inserted.

COMMITTER_UPSERT_ERROR - Static variable in class com.norconex.committer.core.CommitterEvent

The Committer entity update/upsert produced an error.

CommitterContext - Class in com.norconex.committer.core

Holds objects defined outside a committer but useful or required for the committer execution.

CommitterContext.Builder - Class in com.norconex.committer.core

CommitterCorePtProvider - Class in com.norconex.committer.core.spi

For auto registering in BeanMapper.

CommitterCorePtProvider() - Constructor for class com.norconex.committer.core.spi.CommitterCorePtProvider

CommitterEvent - Class in com.norconex.committer.core

Default committer events.

CommitterEvent(CommitterEvent.CommitterEventBuilder<?, ?>) - Constructor for class com.norconex.committer.core.CommitterEvent

CommitterEvent.CommitterEventBuilder<C,B> - Class in com.norconex.committer.core

CommitterEventBuilder() - Constructor for class com.norconex.committer.core.CommitterEvent.CommitterEventBuilder

CommitterException - Exception Class in com.norconex.committer.core

Triggered when something went wrong with committing.

CommitterException() - Constructor for exception class com.norconex.committer.core.CommitterException

CommitterException(String) - Constructor for exception class com.norconex.committer.core.CommitterException

CommitterException(String, Throwable) - Constructor for exception class com.norconex.committer.core.CommitterException

CommitterException(Throwable) - Constructor for exception class com.norconex.committer.core.CommitterException

committerPipeline(CommitterPipeline) - Method in class com.norconex.crawler.core.doc.pipelines.CrawlerDocPipelines.CrawlerDocPipelinesBuilder

CommitterPipeline - Class in com.norconex.crawler.core.doc.pipelines.committer

CommitterPipeline.CommitterPipelineBuilder - Class in com.norconex.crawler.core.doc.pipelines.committer

CommitterPipelineContext - Class in com.norconex.crawler.core.doc.pipelines.committer

A context object for crawler pipelines dealing with Committer.

CommitterPipelineContext(CrawlerSession, CrawlerDocContext) - Constructor for class com.norconex.crawler.core.doc.pipelines.committer.CommitterPipelineContext

CommitterQueue - Interface in com.norconex.committer.core.batch.queue

A committer queue, accumulating requests before they are committed in one or multiple batches.

CommitterQueueException - Exception Class in com.norconex.committer.core.batch.queue

Triggered when something went wrong with the committer queue.

CommitterQueueException() - Constructor for exception class com.norconex.committer.core.batch.queue.CommitterQueueException

CommitterQueueException(String) - Constructor for exception class com.norconex.committer.core.batch.queue.CommitterQueueException

CommitterQueueException(String, Throwable) - Constructor for exception class com.norconex.committer.core.batch.queue.CommitterQueueException

CommitterQueueException(Throwable) - Constructor for exception class com.norconex.committer.core.batch.queue.CommitterQueueException

CommitterRequest - Interface in com.norconex.committer.core

A document (or record, entry, entity, etc.) to be committed.

committers - Static variable in class com.norconex.crawler.core.CrawlerConfig.Fields

committers(List<Committer>) - Method in class com.norconex.committer.core.service.CommitterService.CommitterServiceBuilder

committers(List<Committer>) - Method in class com.norconex.committer.core.service.CommitterServiceEvent.CommitterServiceEventBuilder

committerService(CommitterService<Doc>) - Method in class com.norconex.crawler.core.context.CrawlerContext.Builder

CommitterService<T> - Class in com.norconex.committer.core.service

Wrapper around multiple Committers so they can all be handled as one and facilitating integration with various clients.

CommitterService.CommitterServiceBuilder<T> - Class in com.norconex.committer.core.service

CommitterServiceEvent - Class in com.norconex.committer.core.service

Default committer events.

CommitterServiceEvent(CommitterServiceEvent.CommitterServiceEventBuilder<?, ?>) - Constructor for class com.norconex.committer.core.service.CommitterServiceEvent

CommitterServiceEvent.CommitterServiceEventBuilder<C,B> - Class in com.norconex.committer.core.service

CommitterServiceEventBuilder() - Constructor for class com.norconex.committer.core.service.CommitterServiceEvent.CommitterServiceEventBuilder

CommitterServiceException - Exception Class in com.norconex.committer.core.service

Triggered when an operation when wrong on one or more committers registered to a CommitterService

CommitterServiceException() - Constructor for exception class com.norconex.committer.core.service.CommitterServiceException

CommitterServiceException(String) - Constructor for exception class com.norconex.committer.core.service.CommitterServiceException

CommitterServiceException(String, Throwable) - Constructor for exception class com.norconex.committer.core.service.CommitterServiceException

CommitterServiceException(Throwable) - Constructor for exception class com.norconex.committer.core.service.CommitterServiceException

CommitterUtil - Class in com.norconex.committer.core

Committer-related utility methods.

Committing Documents - Search tag in class com.norconex.crawler.web.WebCrawlerConfig

Section

CommonAttribsResolutionStage - Class in com.norconex.crawler.core.doc.pipelines.importer.stages

Generic pipeline stage for detecting common document attributes, as described in CommonAttributesResolver.

CommonAttribsResolutionStage() - Constructor for class com.norconex.crawler.core.doc.pipelines.importer.stages.CommonAttribsResolutionStage

CommonAttributesResolver - Class in com.norconex.importer.util

Detects common document attributes and set them as document metadata fields.

CommonMatchers - Class in com.norconex.importer.handler

Commonly used TextMatcher instances.

CommonRestrictions - Class in com.norconex.importer.handler

Commonly encountered restrictions that can be applied to Properties instances.

compareTo(Link) - Method in class com.norconex.crawler.web.doc.operations.link.Link

compareTo(Path) - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyPath

COMPLETED - Enum constant in enum class com.norconex.crawler.core.cluster.pipeline.PipelineStatus

COMPLETED - Enum constant in enum class com.norconex.crawler.core.session.CrawlerState

completion() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.pipeline.PipelineWorkerState

Returns a future that completes when this worker state has fully closed, including listener deregistration and scheduler shutdown.

compute(String, BiFunction<String, ? super T, ? extends T>) - Method in interface com.norconex.crawler.core.cluster.CacheMap

compute(String, BiFunction<String, ? super T, ? extends T>) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastMapAdapter

compute(String, BiFunction<String, ? super T, ? extends T>) - Method in class com.norconex.crawler.core.cluster.impl.memory.InMemoryCacheMap

compute(String, BiFunction<String, ? super T, ? extends T>) - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheMap

computeIfAbsent(String, Function<String, ? extends T>) - Method in interface com.norconex.crawler.core.cluster.CacheMap

computeIfAbsent(String, Function<String, ? extends T>) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastMapAdapter

computeIfAbsent(String, Function<String, ? extends T>) - Method in class com.norconex.crawler.core.cluster.impl.memory.InMemoryCacheMap

computeIfAbsent(String, Function<String, ? extends T>) - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheMap

computeIfPresent(String, BiFunction<String, ? super T, ? extends T>) - Method in interface com.norconex.crawler.core.cluster.CacheMap

computeIfPresent(String, BiFunction<String, ? super T, ? extends T>) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastMapAdapter

computeIfPresent(String, BiFunction<String, ? super T, ? extends T>) - Method in class com.norconex.crawler.core.cluster.impl.memory.InMemoryCacheMap

computeIfPresent(String, BiFunction<String, ? super T, ? extends T>) - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheMap

CONCURRENT_UPDATE - Enum constant in enum class com.norconex.committer.solr.SolrClientType

Deprecated.

use SolrClientType.CONCURRENT_UPDATE_HTTP2 instead.

CONCURRENT_UPDATE_HTTP2 - Enum constant in enum class com.norconex.committer.solr.SolrClientType

A client using the HTTP/2 protocol (via Jetty), optimized for mass upload on a single node.

ConcurrentUtil - Class in com.norconex.crawler.core.util

condition() - Method in class com.norconex.importer.handler.DocHandlerContext

Closest wrapping Condition, if applicable.

condition(Condition) - Method in class com.norconex.importer.handler.DocHandlerContext

Closest wrapping Condition, if applicable.

condition(Condition) - Method in class com.norconex.importer.handler.DocHandlerContext.DocHandlerContextBuilder

Closest wrapping Condition, if applicable.

Condition - Interface in com.norconex.importer.handler.condition

A condition usually used in flow creation when configuring importer handlers.

ConditionalDocHandler - Class in com.norconex.importer.handler.condition

Conditionally execute one or more doc handlers (possibly including other conditional doc handlers) upon matching a condition, or not.

ConditionalDocHandler(boolean) - Constructor for class com.norconex.importer.handler.condition.ConditionalDocHandler

ConditionalDocHandler(Condition, boolean) - Constructor for class com.norconex.importer.handler.condition.ConditionalDocHandler

ConditionDeserializer - Class in com.norconex.importer.handler.condition

ConditionDeserializer() - Constructor for class com.norconex.importer.handler.condition.ConditionDeserializer

ConditionGroup - Class in com.norconex.importer.handler.condition

ConditionSerializer - Class in com.norconex.importer.handler.condition

ConditionSerializer() - Constructor for class com.norconex.importer.handler.condition.ConditionSerializer

config() - Method in class com.norconex.crawler.core.context.CrawlerContextFactory.Builder

config(CrawlerContext) - Static method in class com.norconex.crawler.web.util.Web

config(CrawlerConfig) - Method in class com.norconex.crawler.core.context.CrawlerContextFactory.Builder

ConfigurableCondition<T> - Interface in com.norconex.importer.handler.condition

A condition backed by a configuration bean that supports an optional user-supplied label.

ConfigurableDocHandler<T> - Interface in com.norconex.importer.handler

A document handler backed by a configuration bean that supports an optional user-supplied label.

configuration - Static variable in class com.norconex.committer.core.fs.impl.CsvFileCommitter.Fields

configuration - Static variable in class com.norconex.importer.handler.condition.impl.BlankCondition.Fields

configuration - Static variable in class com.norconex.importer.handler.condition.impl.DateCondition.Fields

configuration - Static variable in class com.norconex.importer.handler.condition.impl.NumericCondition.Fields

configureBrowser(WebDriverBrowser, MutableCapabilities) - Method in class com.norconex.crawler.web.fetch.impl.webdriver.HttpSniffer

configureProxy(MutableCapabilities, Host) - Method in enum class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverBrowser

ConfigUtil - Class in com.norconex.crawler.core.util

connect() - Method in interface com.norconex.crawler.core.cluster.ClusterConnector

connect() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastClusterConnector

connect() - Method in class com.norconex.crawler.core.cluster.impl.memory.MemoryClusterConnector

connect() - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreClusterConnector

Considerations - Search tag in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcher

Section

Constant - Class in com.norconex.importer.handler.transformer.impl

ConstantTransformer - Class in com.norconex.importer.handler.transformer.impl

Define and add constant values to documents.

ConstantTransformer() - Constructor for class com.norconex.importer.handler.transformer.impl.ConstantTransformer

ConstantTransformerConfig - Class in com.norconex.importer.handler.transformer.impl

Define and add constant values to documents.

ConstantTransformerConfig() - Constructor for class com.norconex.importer.handler.transformer.impl.ConstantTransformerConfig

consume(Iterator<CommitterRequest>) - Method in class com.norconex.committer.core.batch.AbstractBatchCommitter

consume(Iterator<CommitterRequest>) - Method in interface com.norconex.committer.core.batch.BatchConsumer

CONTAINER_NAME - Enum constant in enum class com.norconex.committer.googlecloudsearch.MetadataField

contains(int, int) - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImage

contains(FeaturedImage) - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImage

contains(Dimension) - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImage

contains(String) - Method in interface com.norconex.crawler.core.cluster.CacheSet

contains(String) - Method in class com.norconex.crawler.core.cluster.impl.memory.InMemoryCacheSet

contains(String) - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheSet

containsKey(String) - Method in interface com.norconex.crawler.core.cluster.CacheMap

containsKey(String) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastMapAdapter

containsKey(String) - Method in class com.norconex.crawler.core.cluster.impl.memory.InMemoryCacheMap

containsKey(String) - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheMap

CONTENT_ENCODING - Static variable in class com.norconex.importer.doc.DocMetaConstants

Document character encoding.

CONTENT_FAMILY - Static variable in class com.norconex.importer.doc.DocMetaConstants

Document content family (general categorization of content types).

CONTENT_LANGUAGE - Enum constant in enum class com.norconex.committer.googlecloudsearch.MetadataField

CONTENT_TYPE - Enum constant in enum class com.norconex.crawler.web.doc.operations.recrawl.impl.GenericRecrawlableResolverConfig.MinFrequency.ApplyTo

CONTENT_TYPE - Static variable in class com.norconex.importer.doc.DocMetaConstants

Document content type (also called "media type", or "mime type").

contentChecksum - Static variable in class com.norconex.crawler.core.ledger.CrawlerEntry.Fields

Content deletion - Search tag in class com.norconex.importer.handler.transformer.impl.DomTransformer

Section

Content deletion - Search tag in class com.norconex.importer.handler.transformer.impl.DomTransformerConfig

Section

Content handling - Search tag in class com.norconex.committer.core.fs.impl.CsvFileCommitter

Section

Content handling - Search tag in class com.norconex.committer.core.fs.impl.CsvFileCommitterConfig

Section

Content source - Search tag in class com.norconex.importer.handler.transformer.impl.UrlExtractorTransformer

Section

Content source - Search tag in class com.norconex.importer.handler.transformer.impl.UrlExtractorTransformerConfig

Section

contentType - Static variable in class com.norconex.crawler.core.ledger.CrawlerEntry.Fields

contentType() - Method in class com.norconex.importer.handler.DocHandlerContext

Content type and character encoding - Search tag in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcher

Section

ContentTypeDetector - Class in com.norconex.importer.doc

Main class to detect all content types.

contentTypeMatcher - Static variable in class com.norconex.importer.handler.parser.impl.OcrConfig.Fields

Content-types - Search tag in class com.norconex.importer.handler.condition.impl.DomCondition

Section

Content-types - Search tag in class com.norconex.importer.handler.condition.impl.DomConditionConfig

Section

Content-types - Search tag in class com.norconex.importer.handler.splitter.impl.DomSplitter

Section

Content-types - Search tag in class com.norconex.importer.handler.splitter.impl.DomSplitterConfig

Section

Content-types - Search tag in class com.norconex.importer.handler.splitter.impl.XmlStreamSplitter

Section

Content-types - Search tag in class com.norconex.importer.handler.splitter.impl.XmlStreamSplitterConfig

Section

Content-types - Search tag in class com.norconex.importer.handler.transformer.impl.DomTransformer

Section

Content-types - Search tag in class com.norconex.importer.handler.transformer.impl.DomTransformerConfig

Section

Content-types - Search tag in class com.norconex.importer.handler.transformer.impl.ImageTransformer

Section

Content-types - Search tag in class com.norconex.importer.handler.transformer.impl.ImageTransformerConfig

Section

contextAdapter(Function<CommitterPipelineContext, ? extends CommitterPipelineContext>) - Method in class com.norconex.crawler.core.doc.pipelines.committer.CommitterPipeline.CommitterPipelineBuilder

contextAdapter(Function<ImporterPipelineContext, ? extends ImporterPipelineContext>) - Method in class com.norconex.crawler.core.doc.pipelines.importer.ImporterPipeline.ImporterPipelineBuilder

contextAdapter(Function<QueuePipelineContext, ? extends QueuePipelineContext>) - Method in class com.norconex.crawler.core.doc.pipelines.queue.QueuePipeline.QueuePipelineBuilder

Conversion is not flawless - Search tag in class com.norconex.importer.handler.transformer.impl.CharsetTransformer

Section

Conversion is not flawless - Search tag in class com.norconex.importer.handler.transformer.impl.CharsetTransformerConfig

Section

convertCharset(InputStream, Charset, OutputStream, Charset) - Static method in class com.norconex.importer.charset.CharsetUtil

Converts the character encoding of the supplied input.

convertCharset(InputStream, String, OutputStream, String) - Static method in class com.norconex.importer.charset.CharsetUtil

Converts the character encoding of the supplied input.

convertCharset(String, String, String) - Static method in class com.norconex.importer.charset.CharsetUtil

Converts the character encoding of the supplied input value.

convertCharset(String, Charset, Charset) - Static method in class com.norconex.importer.charset.CharsetUtil

Converts the character encoding of the supplied input value.

CoordinatorChangeListener - Interface in com.norconex.crawler.core.cluster.impl.hazelcast.event

Listen for coordinator change affecting only this node.

copy(Path, Path, CopyOption...) - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyFileSystemProvider

CopyOperation - Class in com.norconex.importer.handler.transformer.impl

CopyTransformer - Class in com.norconex.importer.handler.transformer.impl

Copies metadata fields.

CopyTransformer() - Constructor for class com.norconex.importer.handler.transformer.impl.CopyTransformer

CopyTransformerConfig - Class in com.norconex.importer.handler.transformer.impl

Copies metadata fields.

CopyTransformerConfig() - Constructor for class com.norconex.importer.handler.transformer.impl.CopyTransformerConfig

COULDSEARCH_ID_FIELD - Static variable in class com.norconex.committer.amazoncloudsearch.AmazonCloudSearchCommitter

CloudSearch mandatory ID field

count(QueryFilter) - Method in interface com.norconex.crawler.core.cluster.CacheMap

Counts the number of entries matching the given query filter.

count(QueryFilter) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastMapAdapter

count(QueryFilter) - Method in class com.norconex.crawler.core.cluster.impl.memory.InMemoryCacheMap

count(QueryFilter) - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheMap

countByStatus(ProcessingStatus) - Method in class com.norconex.crawler.core.ledger.CrawlerEntryLedger

Counts entries with the given processing status.

Counter - Interface in com.norconex.crawler.core.cluster

CountMatchesTransformer - Class in com.norconex.importer.handler.transformer.impl

Counts the number of matches of a given string (or string pattern) and store the resulting value in a field in the specified "toField".

CountMatchesTransformer() - Constructor for class com.norconex.importer.handler.transformer.impl.CountMatchesTransformer

CountMatchesTransformerConfig - Class in com.norconex.importer.handler.transformer.impl

Counts the number of matches of a given string (or string pattern) and store the resulting value in a field in the specified "toField".

CountMatchesTransformerConfig() - Constructor for class com.norconex.importer.handler.transformer.impl.CountMatchesTransformerConfig

crawl() - Method in class com.norconex.crawler.core.Crawler

Crawl without first cleaning the crawler (i.e., incremental crawling).

crawl(boolean) - Method in class com.norconex.crawler.core.Crawler

CRAWL_ALL - Enum constant in enum class com.norconex.crawler.core.cmd.crawl.pipeline.process.CrawlerProcessStep.ProcessQueueAction

CRAWL_RUN - Static variable in class com.norconex.crawler.core.cluster.CacheNames

CRAWL_RUN_ID_KEY - Static variable in class com.norconex.crawler.core.session.CrawlerRunInfoResolver

CRAWL_RUN_INFO_KEY - Static variable in class com.norconex.crawler.core.session.CrawlerRunInfoResolver

CRAWL_SESSION - Static variable in class com.norconex.crawler.core.cluster.CacheNames

crawlConfig(CrawlerConfig) - Method in class com.norconex.crawler.core.context.CrawlerContext.Builder

crawlDelay(float) - Method in class com.norconex.crawler.web.doc.operations.robot.RobotsTxt.RobotsTxtBuilder

Crawl Depth - Search tag in class com.norconex.crawler.web.WebCrawlerConfig

Section

crawlEntry(CrawlerEntry) - Method in class com.norconex.crawler.core.event.CrawlerEvent.CrawlerEventBuilder

Gets the document being processed associated with this event.

crawlEntryLedger(CrawlerEntryLedger) - Method in class com.norconex.crawler.core.context.CrawlerContext.Builder

crawlEntryType() - Method in class com.norconex.crawler.core.CrawlerDriver

The exact type of CrawlerEntry if your crawler is subclassing it.

crawlEntryType(Class<? extends CrawlerEntry>) - Method in class com.norconex.crawler.core.context.CrawlerContext.Builder

crawlEntryType(Class<? extends CrawlerEntry>) - Method in class com.norconex.crawler.core.CrawlerDriver.Builder

The exact type of CrawlerEntry if your crawler is subclassing it.

Crawler - Class in com.norconex.crawler.core

Crawler(CrawlerDriver, CrawlerConfig) - Constructor for class com.norconex.crawler.core.Crawler

CRAWLER - Enum constant in enum class com.norconex.crawler.web.doc.operations.delay.impl.BaseDelayResolverConfig.DelayResolverScope

CRAWLER - Static variable in class com.norconex.crawler.core.cluster.CacheNames

CRAWLER_CLEAN_BEGIN - Static variable in class com.norconex.crawler.core.event.CrawlerEvent

CRAWLER_CLEAN_END - Static variable in class com.norconex.crawler.core.event.CrawlerEvent

CRAWLER_COMMAND_BEGIN - Static variable in class com.norconex.crawler.core.event.CrawlerEvent

Fired just before a command starts executing.

CRAWLER_COMMAND_END - Static variable in class com.norconex.crawler.core.event.CrawlerEvent

Fired just after a command finishes executing.

CRAWLER_CRAWL_BEGIN - Static variable in class com.norconex.crawler.core.event.CrawlerEvent

The crawler is about to begin crawling.

CRAWLER_CRAWL_END - Static variable in class com.norconex.crawler.core.event.CrawlerEvent

The crawler completed crawling execution normally (without being stopped).

CRAWLER_ERROR - Static variable in class com.norconex.crawler.core.event.CrawlerEvent

CRAWLER_SCAN - Enum constant in enum class com.norconex.crawler.core.CrawlerConfig.ChangeDiscovery

The crawler discovers changes by scanning/walking source inventory.

CRAWLER_SESSION_BEGIN - Static variable in class com.norconex.crawler.core.event.CrawlerEvent

Fired just before a crawl session is initialized.

CRAWLER_SESSION_END - Static variable in class com.norconex.crawler.core.event.CrawlerEvent

Fired just after a crawl session has been closed.

CRAWLER_STOP_REQUEST_BEGIN - Static variable in class com.norconex.crawler.core.event.CrawlerEvent

Issued when a request to stop the crawler has been sent.

CRAWLER_STOP_REQUEST_END - Static variable in class com.norconex.crawler.core.event.CrawlerEvent

Issued when a request to stop the crawler has been received.

CRAWLER_STORE_EXPORT_BEGIN - Static variable in class com.norconex.crawler.core.event.CrawlerEvent

CRAWLER_STORE_EXPORT_END - Static variable in class com.norconex.crawler.core.event.CrawlerEvent

CRAWLER_STORE_IMPORT_BEGIN - Static variable in class com.norconex.crawler.core.event.CrawlerEvent

CRAWLER_STORE_IMPORT_END - Static variable in class com.norconex.crawler.core.event.CrawlerEvent

CrawlerAttributes - Class in com.norconex.crawler.core.session

Wrapper around an existing cluster string cache, offering generic attribute setters and getters for convenience.

CrawlerAttributes(CacheMap<String>) - Constructor for class com.norconex.crawler.core.session.CrawlerAttributes

Creates a new CrawlerAttributes instance.

CrawlerBootstrapper - Interface in com.norconex.crawler.core.cmd.crawl.pipeline.bootstrap

CrawlerCallbacks - Class in com.norconex.crawler.core

Optional callbacks invoked at specific times in the crawler life-cycle.

CrawlerCallbacks.CrawlerCallbacksBuilder - Class in com.norconex.crawler.core

CrawlerCallbacks.CrawlerCommandCallback - Interface in com.norconex.crawler.core

Convenience interface providing a default implementation of execute that ignores all commands but CrawlerCommand and offers an overloaded accept method with a single argument.

CrawlerCommand - Class in com.norconex.crawler.core.cmd.crawl

CrawlerCommand(CrawlerPipelineFactory) - Constructor for class com.norconex.crawler.core.cmd.crawl.CrawlerCommand

CrawlerConfig - Class in com.norconex.crawler.core

Base Crawler configuration.

CrawlerConfig() - Constructor for class com.norconex.crawler.core.CrawlerConfig

CrawlerConfig.ChangeDiscovery - Enum Class in com.norconex.crawler.core

Defines how changes are discovered during a crawl run.

CrawlerConfig.Fields - Class in com.norconex.crawler.core

CrawlerConfig.OrphansStrategy - Enum Class in com.norconex.crawler.core

crawlerConfigClass() - Method in class com.norconex.crawler.core.CrawlerDriver

crawlerConfigClass(Class<? extends CrawlerConfig>) - Method in class com.norconex.crawler.core.CrawlerDriver.Builder

CrawlerContext - Class in com.norconex.crawler.core.context

Crawler class holding state properties required for running commands and tasks.

CrawlerContext.Builder - Class in com.norconex.crawler.core.context

CrawlerContextFactory - Class in com.norconex.crawler.core.context

CrawlerContextFactory.Builder - Class in com.norconex.crawler.core.context

CrawlerCorePtProvider - Class in com.norconex.crawler.core.spi

For auto registering in BeanMapper.

CrawlerCorePtProvider() - Constructor for class com.norconex.crawler.core.spi.CrawlerCorePtProvider

CrawlerDelay - Class in com.norconex.crawler.web.doc.operations.delay.impl

It is assumed there will be one instance of this class per crawler defined.

CrawlerDelay() - Constructor for class com.norconex.crawler.web.doc.operations.delay.impl.CrawlerDelay

CrawlerDocContext - Class in com.norconex.crawler.core.doc

Crawl document processing context, encapsulating both the document and its crawl state/history from the crawl entry ledger.

CrawlerDocContext.CrawlerDocContextBuilder - Class in com.norconex.crawler.core.doc

CrawlerDocMetaConstants - Class in com.norconex.crawler.core.doc

Metadata constants for common metadata field names typically set by a collector crawler.

CrawlerDocPipelines - Class in com.norconex.crawler.core.doc.pipelines

CrawlerDocPipelines.CrawlerDocPipelinesBuilder - Class in com.norconex.crawler.core.doc.pipelines

CrawlerDriver - Class in com.norconex.crawler.core

CrawlerDriver.Builder - Class in com.norconex.crawler.core

CrawlerDriver.FetchDriver - Class in com.norconex.crawler.core

CrawlerEntry - Class in com.norconex.crawler.core.ledger

Holds minimal meta information and state necessary to the proper (re)processing of a document in the context of a crawl.

CrawlerEntry() - Constructor for class com.norconex.crawler.core.ledger.CrawlerEntry

CrawlerEntry(String) - Constructor for class com.norconex.crawler.core.ledger.CrawlerEntry

CrawlerEntry.Fields - Class in com.norconex.crawler.core.ledger

CrawlerEntryLedger - Class in com.norconex.crawler.core.ledger

Tracks document state and any other meta information required for document processing.

CrawlerEntryLedger() - Constructor for class com.norconex.crawler.core.ledger.CrawlerEntryLedger

CrawlerEntryLedgerBootstrapper - Class in com.norconex.crawler.core.cmd.crawl.pipeline.bootstrap.ledger

Prepare the doc processing ledger for a new or incremental crawl.

CrawlerEntryLedgerBootstrapper() - Constructor for class com.norconex.crawler.core.cmd.crawl.pipeline.bootstrap.ledger.CrawlerEntryLedgerBootstrapper

CrawlerEvent - Class in com.norconex.crawler.core.event

A crawler event.

CrawlerEvent(CrawlerEvent.CrawlerEventBuilder<?, ?>) - Constructor for class com.norconex.crawler.core.event.CrawlerEvent

CrawlerEvent.CrawlerEventBuilder<C,B> - Class in com.norconex.crawler.core.event

CrawlerEventBuilder() - Constructor for class com.norconex.crawler.core.event.CrawlerEvent.CrawlerEventBuilder

CrawlerEventBus - Class in com.norconex.crawler.core.session

Thin wrapper over EventManager for firing crawler events.

CrawlerEventBus(EventManager) - Constructor for class com.norconex.crawler.core.session.CrawlerEventBus

Crawler Events - Search tag in class com.norconex.crawler.web.WebCrawlerConfig

Section

CrawlerException - Exception Class in com.norconex.crawler.core

Runtime exception for most issues thrown by a crawler.

CrawlerException() - Constructor for exception class com.norconex.crawler.core.CrawlerException

CrawlerException(String) - Constructor for exception class com.norconex.crawler.core.CrawlerException

CrawlerException(String, Throwable) - Constructor for exception class com.norconex.crawler.core.CrawlerException

CrawlerException(Throwable) - Constructor for exception class com.norconex.crawler.core.CrawlerException

CrawlerFsPtProvider - Class in com.norconex.crawler.fs.spi

For auto registering in BeanMapper.

CrawlerFsPtProvider() - Constructor for class com.norconex.crawler.fs.spi.CrawlerFsPtProvider

crawlerId(String) - Method in class com.norconex.crawler.core.cluster.admin.ClusterAdminClient.ClusterAdminClientBuilder

crawlerId(String) - Method in class com.norconex.crawler.core.session.CrawlerRunInfo.CrawlerRunInfoBuilder

Stable identity of a crawler.

CrawlerLifeCycleListener - Class in com.norconex.crawler.core.event.listeners

Listener adapter for crawler life-cycle events (e.g., start, init, stop, clean).

CrawlerLifeCycleListener() - Constructor for class com.norconex.crawler.core.event.listeners.CrawlerLifeCycleListener

CrawlerMetrics - Interface in com.norconex.crawler.core.metrics

Interface used to access crawler metrics across the application.

CrawlerMetricsImpl - Class in com.norconex.crawler.core.metrics

CrawlerMetricsImpl() - Constructor for class com.norconex.crawler.core.metrics.CrawlerMetricsImpl

CrawlerMetricsJMX - Class in com.norconex.crawler.core.metrics

Offers useful methods for registering and unregistering MXBean to JMX.

CrawlerMetricsMXBean - Interface in com.norconex.crawler.core.metrics

CrawlerMode - Enum Class in com.norconex.crawler.core.session

Whether we are executing a full or incremental crawler run.

CrawlerPipelineFactory - Interface in com.norconex.crawler.core.cmd.crawl.pipeline

Creator of a crawl pipeline, the principal flow of a crawler.

CrawlerProcessStep - Class in com.norconex.crawler.core.cmd.crawl.pipeline.process

Main crawler task, getting references from the crawl queue, fetch them, and process them until the queue is empty.

CrawlerProcessStep(String, CrawlerProcessStep.ProcessQueueAction) - Constructor for class com.norconex.crawler.core.cmd.crawl.pipeline.process.CrawlerProcessStep

CrawlerProcessStep.ProcessQueueAction - Enum Class in com.norconex.crawler.core.cmd.crawl.pipeline.process

What to do with ALL current entries in the queue.

CrawlerProgressLogger - Class in com.norconex.crawler.core.cmd.crawl

Logs useful information about the crawler execution progress.

CrawlerProgressLogger(CrawlerContext) - Constructor for class com.norconex.crawler.core.cmd.crawl.CrawlerProgressLogger

CrawlerProgressLogger(CrawlerContext, Supplier<PipelineProgress>) - Constructor for class com.norconex.crawler.core.cmd.crawl.CrawlerProgressLogger

CrawlerResumeState - Enum Class in com.norconex.crawler.core.session

Describes the state of the crawler when launched (new launch or resuming a non completed/failed one).

CrawlerRunCoordinator - Class in com.norconex.crawler.core.session

Coordinates once-per-session and once-per-run task deduplication using the distributed cache, and exposes the run-scoped attribute store.

CrawlerRunCoordinator(CacheMap<String>, CacheMap<String>, CrawlerAttributes) - Constructor for class com.norconex.crawler.core.session.CrawlerRunCoordinator

CrawlerRunInfo - Class in com.norconex.crawler.core.session

Details on the current crawl run.

CrawlerRunInfo.CrawlerRunInfoBuilder - Class in com.norconex.crawler.core.session

CrawlerRunInfoResolver - Class in com.norconex.crawler.core.session

Establishes the current crawl run information specific to this run.

CrawlerSession - Class in com.norconex.crawler.core.session

A crawl session, representing a crawl from begin to finish, which may include zero to multiple "resumes" from stops, or failures.

CrawlerSession.State - Class in com.norconex.crawler.core.session

CrawlerSessionFactory - Class in com.norconex.crawler.core.session

CrawlerState - Enum Class in com.norconex.crawler.core.session

CrawlerStateStore - Class in com.norconex.crawler.core.session

Manages persistent crawl-state and session-scoped attributes stored in the distributed session cache.

CrawlerStateStore(CacheMap<String>, CrawlerAttributes, CrawlerAttributes) - Constructor for class com.norconex.crawler.core.session.CrawlerStateStore

Creates a new CrawlerStateStore instance.

CrawlerWebPtProvider - Class in com.norconex.crawler.web.spi

For auto registering in BeanMapper.

CrawlerWebPtProvider() - Constructor for class com.norconex.crawler.web.spi.CrawlerWebPtProvider

crawlMode(CrawlerMode) - Method in class com.norconex.crawler.core.session.CrawlerRunInfo.CrawlerRunInfoBuilder

The mode used to crawl web sites.

crawlPipelineFactory() - Method in class com.norconex.crawler.core.CrawlerDriver

crawlPipelineFactory(CrawlerPipelineFactory) - Method in class com.norconex.crawler.core.CrawlerDriver.Builder

crawlResumeState(CrawlerResumeState) - Method in class com.norconex.crawler.core.session.CrawlerRunInfo.CrawlerRunInfoBuilder

Whether we are starting a new crawl session or resuming a previous one.

crawlRunId(String) - Method in class com.norconex.crawler.core.session.CrawlerRunInfo.CrawlerRunInfoBuilder

Unique identifier for each time the crawler starts (until termination).

crawlSession(CrawlerSession) - Method in class com.norconex.crawler.core.event.CrawlerEvent.CrawlerEventBuilder

crawlSessionId(String) - Method in class com.norconex.crawler.core.session.CrawlerRunInfo.CrawlerRunInfoBuilder

Full life-cycle identifier for a single crawl.

Crawl Speed - Search tag in class com.norconex.crawler.web.WebCrawlerConfig

Section

create() - Method in class com.norconex.crawler.core.context.CrawlerContextFactory

create() - Static method in class com.norconex.crawler.fs.doc.pipelines.FsPipelines

create() - Static method in class com.norconex.crawler.fs.FsCrawlerDriverFactory

create() - Static method in class com.norconex.crawler.web.doc.pipelines.WebDocPipelines

create() - Static method in class com.norconex.crawler.web.WebCrawlerDriverFactory

create(CrawlerConfig) - Static method in class com.norconex.crawler.fs.FsCrawler

create(CrawlerDriver, CrawlerConfig) - Static method in class com.norconex.crawler.core.session.CrawlerSessionFactory

create(ProcessingOutcome, String, Exception) - Method in interface com.norconex.crawler.core.fetch.MultiFetcher.UnsuccessfulResponseFactory

create(CrawlerSession) - Method in interface com.norconex.crawler.core.cmd.crawl.pipeline.CrawlerPipelineFactory

Create a crawler pipeline

create(CrawlerSession) - Method in class com.norconex.crawler.core.cmd.crawl.pipeline.DefaultCrawlPipelineFactory

create(WebDriverFetcherConfig) - Static method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFactory

create(WebCrawlerConfig) - Static method in class com.norconex.crawler.web.WebCrawler

Creates a Web Crawler instance.

create(String, ZoneId) - Static method in class com.norconex.importer.handler.condition.impl.DateProviderFactory

Create a new date supplier based on the given string.

create(String) - Method in enum class com.norconex.committer.solr.SolrClientType

create(String) - Method in class com.norconex.crawler.core.util.ScopedThreadFactoryCreator

CREATE_TIME - Enum constant in enum class com.norconex.committer.googlecloudsearch.MetadataField

createConnectionConfig() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcher

createConnectionManager() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcher

createCrawlEntry(String) - Method in class com.norconex.crawler.core.context.CrawlerContext

createCredentialsProvider() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcher

createDateTime(ZoneId) - Method in class com.norconex.importer.handler.condition.impl.DateProviderFactory.DynamicFixedDateTimeProvider

createDefaultCookieStore() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcher

Creates the default cookie store to be added to each request context.

createDefaultRequestHeaders() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcher

Creates a list of HTTP headers based on configuration.

createDirectory(Path, FileAttribute<?>...) - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyFileSystemProvider

createDocContext(CrawlerEntry) - Method in class com.norconex.crawler.core.context.CrawlerContext

createDocumentChecksum(Doc) - Method in class com.norconex.crawler.core.doc.operations.checksum.AbstractDocumentChecksummer

createDocumentChecksum(Doc) - Method in interface com.norconex.crawler.core.doc.operations.checksum.DocumentChecksummer

Creates a document checksum.

createDocWriter(Writer) - Method in class com.norconex.committer.core.fs.AbstractFsCommitter

createDocWriter(Writer) - Method in class com.norconex.committer.core.fs.impl.CsvFileCommitter

createDocWriter(Writer) - Method in class com.norconex.committer.core.fs.impl.JsonFileCommitter

createDocWriter(Writer) - Method in class com.norconex.committer.core.fs.impl.XmlFileCommitter

createDriverSession(WebDriverLocation, MutableCapabilities) - Method in enum class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverBrowser

createHazelcastInstance(Config) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastCluster

createHttpClient() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcher

createMetadataChecksum(Properties) - Method in class com.norconex.crawler.core.doc.operations.checksum.AbstractMetadataChecksummer

createMetadataChecksum(Properties) - Method in interface com.norconex.crawler.core.doc.operations.checksum.MetadataChecksummer

Creates a metadata checksum.

createOptions(WebDriverLocation) - Method in enum class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverBrowser

createPath(String) - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyFileSystem

createPath(List<String>) - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyPath

createProxy() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcher

createRecursiveParser(DocHandlerContext, Writer, List<Doc>) - Method in class com.norconex.importer.handler.parser.impl.DefaultParser

createRequestConfig() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcher

createRestClient() - Method in class com.norconex.committer.elasticsearch.ElasticsearchCommitter

createRoutePlanner(SchemePortResolver) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcher

createSchemePortResolver() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcher

createSniffer(RestClient) - Method in class com.norconex.committer.elasticsearch.ElasticsearchCommitter

createSSLContext() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcher

createTlsSocketStrategy(SSLContext) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcher

createUriRequest(String, HttpMethod) - Static method in class com.norconex.crawler.web.fetch.util.ApacheHttpUtil

Creates an HTTP request.

createUriRequest(String, String) - Static method in class com.norconex.crawler.web.fetch.util.ApacheHttpUtil

Creates an HTTP request.

creationTime() - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyFileAttributes

credentials - Static variable in class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthConfig.Fields

Crop() - Constructor for class com.norconex.importer.handler.transformer.impl.ImageTransformerConfig.Crop

CSSSELECTOR - Enum constant in enum class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcherConfig.WaitElementType

Locate by CSS selector expression.

CSSSELECTOR - Enum constant in enum class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig.WaitElementType

CsvColumn - Class in com.norconex.committer.core.fs.impl

Identifies a column in comma-separated-value (CSV) content.

CsvColumn() - Constructor for class com.norconex.committer.core.fs.impl.CsvColumn

CsvColumn.Fields - Class in com.norconex.committer.core.fs.impl

CsvFileCommitter - Class in com.norconex.committer.core.fs.impl

Commits documents to CSV files (Comma Separated Value).

CsvFileCommitter() - Constructor for class com.norconex.committer.core.fs.impl.CsvFileCommitter

CsvFileCommitter.Fields - Class in com.norconex.committer.core.fs.impl

CsvFileCommitterConfig - Class in com.norconex.committer.core.fs.impl

Commits documents to CSV files (Comma Separated Value).

CsvFileCommitterConfig() - Constructor for class com.norconex.committer.core.fs.impl.CsvFileCommitterConfig

CsvFileCommitterConfig.CsvFormat - Enum Class in com.norconex.committer.core.fs.impl

CsvFileCommitterConfig.Fields - Class in com.norconex.committer.core.fs.impl

CSV Format - Search tag in class com.norconex.committer.core.fs.impl.CsvFileCommitter

Section

CSV Format - Search tag in class com.norconex.committer.core.fs.impl.CsvFileCommitterConfig

Section

CsvSplitter - Class in com.norconex.importer.handler.splitter.impl

Split files with Coma-Separated values (or any other characters, like tab) into one document per line.

CsvSplitter() - Constructor for class com.norconex.importer.handler.splitter.impl.CsvSplitter

CsvSplitterConfig - Class in com.norconex.importer.handler.splitter.impl

Split files with Coma-Separated values (or any other characters, like tab) into one document per line.

CsvSplitterConfig() - Constructor for class com.norconex.importer.handler.splitter.impl.CsvSplitterConfig

currentCrawlEntry(CrawlerEntry) - Method in class com.norconex.crawler.core.doc.CrawlerDocContext.CrawlerDocContextBuilder

CurrentDateTransformer - Class in com.norconex.importer.handler.transformer.impl

Adds the current computer UTC date to the specified field.

CurrentDateTransformer() - Constructor for class com.norconex.importer.handler.transformer.impl.CurrentDateTransformer

CurrentDateTransformerConfig - Class in com.norconex.importer.handler.transformer.impl

Adds the current computer UTC date to the specified field.

CurrentDateTransformerConfig() - Constructor for class com.norconex.importer.handler.transformer.impl.CurrentDateTransformerConfig

currentPipelineStepRecordOrFirst(HazelcastCluster, Pipeline) - Static method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastUtil

currentStepId(String) - Method in class com.norconex.crawler.core.cluster.pipeline.PipelineProgress.PipelineProgressBuilder

currentStepIndex(int) - Method in class com.norconex.crawler.core.cluster.pipeline.PipelineProgress.PipelineProgressBuilder

CUSTOM - Enum constant in enum class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverBrowser

CustomDriverOptions() - Constructor for class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverBrowser.CustomDriverOptions

CUSTOMER - Enum constant in enum class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.PrincipalType

Custom recrawl frequencies: - Search tag in class com.norconex.crawler.web.doc.operations.recrawl.impl.GenericRecrawlableResolver

Section

D

DAILY - Enum constant in enum class com.norconex.crawler.web.doc.operations.sitemap.SitemapChangeFrequency

DATA_CONNECTION_REF - Static variable in class com.norconex.crawler.core.cluster.impl.hazelcast.JdbcHazelcastConfigurer

Name of the shared JDBC data-connection referenced by store configs.

DATE - Enum constant in enum class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.StructuredDataType

DATE - Enum constant in enum class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig.StorageDiskStructure

Create directories for each date (e.g., 2000/12/31/).

DATE - Enum constant in enum class com.norconex.crawler.web.fetch.util.DocImageHandlerConfig.DirStructure

Create directories for each date (e.g., 2000/12/31/).

DateCondition - Class in com.norconex.importer.handler.condition.impl

A condition based on the date value(s) of matching metadata fields given the supplied date format.

DateCondition() - Constructor for class com.norconex.importer.handler.condition.impl.DateCondition

DateCondition.Fields - Class in com.norconex.importer.handler.condition.impl

DateCondition.TimeUnit - Enum Class in com.norconex.importer.handler.condition.impl

DateConditionConfig - Class in com.norconex.importer.handler.condition.impl

A condition based on the date value(s) of matching metadata fields given the supplied date format.

DateConditionConfig() - Constructor for class com.norconex.importer.handler.condition.impl.DateConditionConfig

Date format: - Search tag in class com.norconex.importer.handler.condition.impl.DateProviderFactory

Section

DateFormatTransformer - Class in com.norconex.importer.handler.transformer.impl

Formats a date from any given format to a format of choice, as per the formatting options found on ZonedDateTimeParser with the addition of the format "EPOCH", which represents the difference, measured in milliseconds, between the date and midnight, January 1, 1970.

DateFormatTransformer() - Constructor for class com.norconex.importer.handler.transformer.impl.DateFormatTransformer

DateFormatTransformerConfig - Class in com.norconex.importer.handler.transformer.impl

Formats a date from any given format to a format of choice, as per the formatting options found on ZonedDateTimeParser with the addition of the format "EPOCH", which represents the difference, measured in milliseconds, between the date and midnight, January 1, 1970.

DateFormatTransformerConfig() - Constructor for class com.norconex.importer.handler.transformer.impl.DateFormatTransformerConfig

DateFormatTransformerConfig.Fields - Class in com.norconex.importer.handler.transformer.impl

DateProvider - Interface in com.norconex.importer.handler.condition.impl

Provides a date time value which may be the same on each invocation, or change each time, based on implementation.

DateProviderFactory - Class in com.norconex.importer.handler.condition.impl

Creates suppliers of static or dynamic dates, from a formatted string.

DateProviderFactory.DynamicFixedDateTimeProvider - Class in com.norconex.importer.handler.condition.impl

Returns a supplier that dynamically generates a date-time, that once generated, never changes for that same supplier.

DateProviderFactory.DynamicFloatingDateTimeProvider - Class in com.norconex.importer.handler.condition.impl

Returns a supplier that dynamically generates a date-time, that changes with every invocation.

DateProviderFactory.StaticDateTimeProvider - Class in com.norconex.importer.handler.condition.impl

Static date-time, supplying the value passed in constructor.

DATETIME - Enum constant in enum class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig.StorageDiskStructure

Create directories for each date and time, up to seconds (e.g., 2000/12/31/13/34/12/).

DATETIME - Enum constant in enum class com.norconex.crawler.web.fetch.util.DocImageHandlerConfig.DirStructure

Create directories for each date and time, up to seconds (e.g., 2000/12/31/13/34/12/).

DateValueMatcher - Class in com.norconex.importer.handler.condition.impl

Immutable date-value matcher, supporting both date expressions and standard operators.

DateValueMatcher(Operator, DateProvider) - Constructor for class com.norconex.importer.handler.condition.impl.DateValueMatcher

DateValueMatcher(Operator, String, ZoneId) - Constructor for class com.norconex.importer.handler.condition.impl.DateValueMatcher

DAY - Enum constant in enum class com.norconex.importer.handler.condition.impl.DateCondition.TimeUnit

DEBUG - Enum constant in enum class com.norconex.committer.core.impl.LogCommitterConfig.LogLevel

DebugTransformer - Class in com.norconex.importer.handler.transformer.impl

A utility tagger to help with troubleshooting of document importing.

DebugTransformer() - Constructor for class com.norconex.importer.handler.transformer.impl.DebugTransformer

DebugTransformerConfig - Class in com.norconex.importer.handler.transformer.impl

A utility tagger to help with troubleshooting of document importing.

DebugTransformerConfig() - Constructor for class com.norconex.importer.handler.transformer.impl.DebugTransformerConfig

declaredCharset() - Method in class com.norconex.importer.charset.CharsetDetector.CharsetDetectorBuilder

declaredCharset(String) - Method in class com.norconex.importer.charset.CharsetDetector.CharsetDetectorBuilder

declaredCharset(Charset) - Method in class com.norconex.importer.charset.CharsetDetector.CharsetDetectorBuilder

DECODE_UNRESERVED_CHARACTERS - Enum constant in enum class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizerConfig.Normalization

decodeUtf8ErrorBody(byte[]) - Static method in class com.norconex.crawler.fs.fetch.impl.FetcherSupport

decrementAndGet() - Method in interface com.norconex.crawler.core.cluster.Counter

Deduplication - Search tag in class com.norconex.crawler.web.WebCrawlerConfig

Section

dedupService(DedupService) - Method in class com.norconex.crawler.core.context.CrawlerContext.Builder

DedupService - Class in com.norconex.crawler.core.doc.pipelines

DedupService() - Constructor for class com.norconex.crawler.core.doc.pipelines.DedupService

DEFAULT - Enum constant in enum class com.norconex.committer.core.fs.impl.CsvFileCommitterConfig.CsvFormat

DEFAULT - Static variable in class com.norconex.crawler.core.util.StringSanitizer

DEFAULT_ADMIN_PORT - Static variable in class com.norconex.crawler.core.cluster.ClusterConfig

Default port used to communicate via a node for some administrative crawler cluster tasks.

DEFAULT_API_VERSION - Static variable in class com.norconex.committer.azurecognitivesearch.AzureSearchCommitterConfig

Default Azure Search API version

DEFAULT_APPLICATION_NAME - Static variable in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig

Default Google Cloud Search committer application name.

DEFAULT_AZURE_CONTENT_FIELD - Static variable in class com.norconex.committer.azurecognitivesearch.AzureSearchCommitterConfig

Default Azure Search content field

DEFAULT_AZURE_KEY_FIELD - Static variable in class com.norconex.committer.azurecognitivesearch.AzureSearchCommitterConfig

Default Azure Search document key field

DEFAULT_BATCH_SIZE - Static variable in class com.norconex.committer.core.batch.queue.impl.FsQueueConfig

DEFAULT_CONNECTION_TIMEOUT - Static variable in class com.norconex.committer.elasticsearch.ElasticsearchCommitterConfig

1 second.

DEFAULT_CONTENT_TYPE_PATTERN - Static variable in class com.norconex.crawler.web.doc.operations.link.impl.RegexLinkExtractorConfig

DEFAULT_COULDSEARCH_CONTENT_FIELD - Static variable in class com.norconex.committer.amazoncloudsearch.AmazonCloudSearchCommitterConfig

Default CloudSearch content field

DEFAULT_DEFAULT_FILE_NAME - Static variable in class com.norconex.importer.handler.transformer.impl.SaveDocumentTransformerConfig

DEFAULT_DELAY - Static variable in class com.norconex.crawler.web.doc.operations.delay.impl.BaseDelayResolverConfig

Default delay is 3 seconds.

DEFAULT_ELASTICSEARCH_CONTENT_FIELD - Static variable in class com.norconex.committer.elasticsearch.ElasticsearchCommitterConfig

DEFAULT_ESCAPE_CHARACTER - Static variable in class com.norconex.importer.handler.splitter.impl.CsvSplitterConfig

DEFAULT_FALLBACK_CHARSET - Static variable in class com.norconex.crawler.web.fetch.util.GenericRedirectUrlProviderConfig

DEFAULT_FALLBACK_STRATEGY - Static variable in class com.norconex.crawler.core.doc.operations.spoil.impl.GenericSpoiledReferenceStrategizerConfig

DEFAULT_FIELD - Static variable in class com.norconex.importer.handler.transformer.impl.CurrentDateTransformerConfig

DEFAULT_FIELD - Static variable in class com.norconex.importer.handler.transformer.impl.UuidTransformerConfig

DEFAULT_FIELD_NAME - Static variable in class com.norconex.importer.handler.transformer.impl.BinaryContentTransformerConfig

Default metadata field name.

DEFAULT_FILE - Static variable in class com.norconex.importer.handler.transformer.impl.FieldReportTransformerConfig

DEFAULT_FILENAME_PREFIX - Static variable in class com.norconex.crawler.web.event.listeners.UrlStatusCrawlerEventListenerConfig

DEFAULT_HEADING_MAX_LENGTH - Static variable in class com.norconex.importer.handler.transformer.impl.TitleGeneratorTransformerConfig

DEFAULT_HEADING_MIN_LENGTH - Static variable in class com.norconex.importer.handler.transformer.impl.TitleGeneratorTransformerConfig

DEFAULT_IDLE_TIMEOUT - Static variable in class com.norconex.crawler.core.CrawlerConfig

DEFAULT_IMAGE_CACHE_SIZE - Static variable in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig

DEFAULT_IMAGE_FORMAT - Static variable in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig

DEFAULT_IMAGE_FORMAT - Static variable in class com.norconex.crawler.web.fetch.util.DocImageHandlerConfig

DEFAULT_MAX_BUFFER_SIZE - Static variable in class com.norconex.crawler.web.fetch.impl.webdriver.HttpSnifferConfig

DEFAULT_MAX_CONNECTIONS - Static variable in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

DEFAULT_MAX_CONNECTIONS_PER_ROUTE - Static variable in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

DEFAULT_MAX_IDLE_TIME - Static variable in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

DEFAULT_MAX_PER_FOLDER - Static variable in class com.norconex.committer.core.batch.queue.impl.FsQueueConfig

DEFAULT_MAX_READ_SIZE - Static variable in class com.norconex.importer.handler.transformer.impl.TitleGeneratorTransformerConfig

DEFAULT_MAX_REDIRECT - Static variable in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

DEFAULT_MAX_SAMPLES - Static variable in class com.norconex.importer.handler.transformer.impl.FieldReportTransformerConfig

DEFAULT_MAX_STREAM_CACHE_POOL_SIZE - Static variable in class com.norconex.importer.ImporterConfig

100 MB.

DEFAULT_MAX_STREAM_CACHE_SIZE - Static variable in class com.norconex.importer.ImporterConfig

1 GB.

DEFAULT_MAX_URL_LENGTH - Static variable in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractorConfig

Default maximum length a URL can have.

DEFAULT_MAX_URL_LENGTH - Static variable in class com.norconex.crawler.web.doc.operations.link.impl.RegexLinkExtractorConfig

Default maximum length a URL can have.

DEFAULT_MIN_PROGRESS_LOGGING_INTERVAL - Static variable in class com.norconex.crawler.core.CrawlerConfig

DEFAULT_MIN_SIZE - Static variable in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig

DEFAULT_MODEL_PATH - Static variable in class com.norconex.importer.handler.parser.impl.SentimentConfig

Default Tika sentiment model URL.

DEFAULT_MULTI_VALUES_JOINER - Static variable in class com.norconex.committer.sql.SqlCommitterConfig

Default multi-value join string

DEFAULT_NATIVE_RETRY_BASE_DELAY - Static variable in class com.norconex.crawler.fs.fetch.impl.m365graph.M365GraphFetcherConfig

DEFAULT_NATIVE_RETRY_STATUS_CODES - Static variable in class com.norconex.crawler.fs.fetch.impl.m365graph.M365GraphFetcherConfig

DEFAULT_NEO4J_CONTENT_PROPERTY - Static variable in class com.norconex.committer.neo4j.Neo4jCommitterConfig

DEFAULT_NEO4J_ID_PROPERTY - Static variable in class com.norconex.committer.neo4j.Neo4jCommitterConfig

DEFAULT_NODE - Static variable in class com.norconex.committer.elasticsearch.ElasticsearchCommitterConfig

DEFAULT_NODE_URL - Static variable in class com.norconex.crawler.core.cluster.admin.ClusterAdminClient

DEFAULT_NOT_FOUND_STATUS_CODES - Static variable in class com.norconex.crawler.fs.fetch.impl.box.BoxFetcherConfig

DEFAULT_NOT_FOUND_STATUS_CODES - Static variable in class com.norconex.crawler.fs.fetch.impl.egnyte.EgnyteFetcherConfig

DEFAULT_NOT_FOUND_STATUS_CODES - Static variable in class com.norconex.crawler.fs.fetch.impl.m365graph.M365GraphFetcherConfig

DEFAULT_NOT_FOUND_STATUS_CODES - Static variable in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

DEFAULT_OBJECT_TYPE - Static variable in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig

Default object type value when no metadata value is provided.

DEFAULT_OBJECT_TYPE_SOURCE_FIELD - Static variable in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig

Default document object type metadata source field.

DEFAULT_OOXML_EXPORT_MIME_TYPES - Static variable in class com.norconex.crawler.fs.fetch.impl.googledrive.GoogleDriveFetcherConfig

DEFAULT_PAGE_CONTENT_TYPE_PATTERN - Static variable in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig

DEFAULT_PATHS - Static variable in class com.norconex.crawler.web.doc.operations.sitemap.impl.GenericSitemapLocatorConfig

DEFAULT_PDF_EXPORT_MIME_TYPES - Static variable in class com.norconex.crawler.fs.fetch.impl.googledrive.GoogleDriveFetcherConfig

DEFAULT_QUOTE_CHARACTER - Static variable in class com.norconex.importer.handler.splitter.impl.CsvSplitterConfig

DEFAULT_REFERENCE_PAGE_PREFIX - Static variable in class com.norconex.importer.handler.splitter.impl.PdfPageSplitter

DEFAULT_RESPONSE_TIMEOUT - Static variable in class com.norconex.crawler.web.fetch.impl.webdriver.HttpSnifferConfig

DEFAULT_SAVE_DIR_PATH - Static variable in class com.norconex.importer.handler.transformer.impl.SaveDocumentTransformerConfig

DEFAULT_SCALE_SIZE - Static variable in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig

DEFAULT_SCHEMES - Static variable in class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractorConfig

DEFAULT_SCHEMES - Static variable in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractorConfig

Default supported URL schemes (http, https, and ftp).

DEFAULT_SCOPE - Static variable in class com.norconex.crawler.web.doc.operations.delay.impl.BaseDelayResolverConfig

DEFAULT_SCREENSHOT_DIR - Static variable in class com.norconex.crawler.web.fetch.util.ScreenshotHandlerConfig

DEFAULT_SCREENSHOT_DIR_FIELD - Static variable in class com.norconex.crawler.web.fetch.util.ScreenshotHandlerConfig

DEFAULT_SCREENSHOT_META_FIELD - Static variable in class com.norconex.crawler.web.fetch.util.ScreenshotHandlerConfig

DEFAULT_SEGMENT_COUNT - Static variable in class com.norconex.crawler.web.doc.operations.filter.impl.SegmentCountUrlFilterConfig

Default segment count.

DEFAULT_SEGMENT_SEPARATOR_PATTERN - Static variable in class com.norconex.crawler.web.doc.operations.filter.impl.SegmentCountUrlFilterConfig

Default segment separator pattern.

DEFAULT_SEPARATOR_CHARACTER - Static variable in class com.norconex.importer.handler.splitter.impl.CsvSplitterConfig

DEFAULT_SERVICE_URL - Static variable in class com.norconex.importer.handler.parser.impl.GrobidConfig

Default Grobid REST service URL.

DEFAULT_SOCKET_TIMEOUT - Static variable in class com.norconex.committer.elasticsearch.ElasticsearchCommitterConfig

30 seconds.

DEFAULT_SOLR_CONTENT_FIELD - Static variable in class com.norconex.committer.solr.SolrCommitterConfig

Default Solr content field

DEFAULT_SOLR_ID_FIELD - Static variable in class com.norconex.committer.solr.SolrCommitterConfig

Default Solr ID field

DEFAULT_SPLIT_PATTERN - Static variable in class com.norconex.importer.handler.transformer.impl.SaveDocumentTransformerConfig

DEFAULT_SQL_CONTENT_FIELD - Static variable in class com.norconex.committer.sql.SqlCommitterConfig

Default SQL content field

DEFAULT_STORAGE - Static variable in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig

DEFAULT_STORAGE_DISK_DIR - Static variable in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig

Default featured image directory, relative to the crawler working directory.

DEFAULT_STORAGE_DISK_STRUCTURE - Static variable in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig

DEFAULT_TARGET_CHARSET - Static variable in class com.norconex.importer.handler.transformer.impl.CharsetTransformerConfig

DEFAULT_TARGET_FORMAT - Static variable in class com.norconex.importer.handler.transformer.impl.ImageTransformerConfig

DEFAULT_TEMP_DIR_PATH - Static variable in class com.norconex.importer.ImporterConfig

DEFAULT_TEXT_EXPORT_MIME_TYPES - Static variable in class com.norconex.crawler.fs.fetch.impl.googledrive.GoogleDriveFetcherConfig

DEFAULT_TIMEOUT - Static variable in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

DEFAULT_TITLE_MAX_LENGTH - Static variable in class com.norconex.importer.handler.transformer.impl.TitleGeneratorTransformerConfig

DEFAULT_TITLE_SOURCE_FIELD - Static variable in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig

Default document title metadata source field.

DEFAULT_TO_FIELD - Static variable in class com.norconex.importer.handler.transformer.impl.TitleGeneratorTransformerConfig

DEFAULT_TRUNCATE_AT - Static variable in class com.norconex.committer.core.fs.impl.CsvFileCommitter

DEFAULT_TRUNCATE_AT - Static variable in class com.norconex.committer.core.fs.impl.CsvFileCommitterConfig

DEFAULT_TYPES - Static variable in class com.norconex.crawler.web.fetch.util.DocImageHandlerConfig

DEFAULT_UPDATE_TIME_SOURCE_FIELD - Static variable in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig

Default update time metadata source field.

DEFAULT_URL - Static variable in class com.norconex.committer.idol.IdolCommitterConfig

DEFAULT_VALID_STATUS_CODES - Static variable in class com.norconex.crawler.fs.fetch.impl.box.BoxFetcherConfig

DEFAULT_VALID_STATUS_CODES - Static variable in class com.norconex.crawler.fs.fetch.impl.egnyte.EgnyteFetcherConfig

DEFAULT_VALID_STATUS_CODES - Static variable in class com.norconex.crawler.fs.fetch.impl.m365graph.M365GraphFetcherConfig

DEFAULT_VALID_STATUS_CODES - Static variable in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

DEFAULT_WORKDIR - Static variable in class com.norconex.crawler.core.CrawlerConfig

Default relative directory where generated files are written.

DefaultCrawlPipelineFactory - Class in com.norconex.crawler.core.cmd.crawl.pipeline

DefaultCrawlPipelineFactory() - Constructor for class com.norconex.crawler.core.cmd.crawl.pipeline.DefaultCrawlPipelineFactory

defaultExportMimeTypes() - Method in class com.norconex.crawler.fs.fetch.impl.googledrive.GoogleDriveFetcherConfig

DefaultParser - Class in com.norconex.importer.handler.parser.impl

Parser class when no other handlers are specified.

DefaultParser() - Constructor for class com.norconex.importer.handler.parser.impl.DefaultParser

DefaultParserConfig - Class in com.norconex.importer.handler.parser.impl

Parser class when no other handlers are specified.

DefaultParserConfig() - Constructor for class com.norconex.importer.handler.parser.impl.DefaultParserConfig

deferredShutdownDuration - Static variable in class com.norconex.crawler.core.CrawlerConfig.Fields

delay(long, long) - Method in class com.norconex.crawler.web.doc.operations.delay.impl.AbstractDelay

delay(long, String) - Method in class com.norconex.crawler.web.doc.operations.delay.impl.AbstractDelay

delay(long, String) - Method in class com.norconex.crawler.web.doc.operations.delay.impl.CrawlerDelay

delay(long, String) - Method in class com.norconex.crawler.web.doc.operations.delay.impl.SiteDelay

delay(long, String) - Method in class com.norconex.crawler.web.doc.operations.delay.impl.ThreadDelay

delay(RobotsTxt, String) - Method in interface com.norconex.crawler.web.doc.operations.delay.DelayResolver

Delay crawling activities (if applicable).

delay(RobotsTxt, String) - Method in class com.norconex.crawler.web.doc.operations.delay.impl.AbstractDelayResolver

DelayRange<T> - Class in com.norconex.crawler.web.doc.operations.delay.impl

DelayRange() - Constructor for class com.norconex.crawler.web.doc.operations.delay.impl.DelayRange

DelayRange(T, T) - Constructor for class com.norconex.crawler.web.doc.operations.delay.impl.DelayRange

DelayRange.Fields - Class in com.norconex.crawler.web.doc.operations.delay.impl

DelayReferencePattern - Class in com.norconex.crawler.web.doc.operations.delay.impl

DelayReferencePattern(String, Duration) - Constructor for class com.norconex.crawler.web.doc.operations.delay.impl.DelayReferencePattern

delayResolver - Static variable in class com.norconex.crawler.web.WebCrawlerConfig.Fields

DelayResolver - Interface in com.norconex.crawler.web.doc.operations.delay

Resolves and creates intentional "delays" to increase document download time intervals.

DelayResolverStage - Class in com.norconex.crawler.web.doc.pipelines.importer.stages

Wait for configured or default delay to expire.

DelayResolverStage() - Constructor for class com.norconex.crawler.web.doc.pipelines.importer.stages.DelayResolverStage

DelaySchedule - Class in com.norconex.crawler.web.doc.operations.delay.impl

DelaySchedule() - Constructor for class com.norconex.crawler.web.doc.operations.delay.impl.DelaySchedule

DelaySchedule.DOW - Enum Class in com.norconex.crawler.web.doc.operations.delay.impl

delete(DeleteRequest) - Method in class com.norconex.committer.core.AbstractCommitter

delete(DeleteRequest) - Method in interface com.norconex.committer.core.Committer

Deletes the entity represented by the supplied request from the target of this committer.

delete(QueryFilter) - Method in interface com.norconex.crawler.core.cluster.CacheMap

Deletes entries matching the given query filter.

delete(QueryFilter) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastMapAdapter

delete(QueryFilter) - Method in class com.norconex.crawler.core.cluster.impl.memory.InMemoryCacheMap

delete(QueryFilter) - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheMap

delete(Long) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.jdbc.StringJdbcQueueStore

delete(Long) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.jdbc.TypedJdbcQueueStore

delete(String) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.jdbc.StringJdbcMapStore

delete(Path) - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyFileSystemProvider

delete(T) - Method in class com.norconex.committer.core.service.CommitterService

Deletes an object using all accepting committers.

DELETE - Enum constant in enum class com.norconex.crawler.core.CrawlerConfig.OrphansStrategy

Deleting orphans sends them to the Committer for deletions and they are removed from the internal reference cache.

DELETE - Enum constant in enum class com.norconex.crawler.core.doc.operations.spoil.SpoiledReferenceStrategy

Deleting spoiled references sends them to the Committer for deletions and they are removed from the internal reference cache.

DELETE_ALL - Enum constant in enum class com.norconex.crawler.core.cmd.crawl.pipeline.process.CrawlerProcessStep.ProcessQueueAction

deleteAll(Collection<Long>) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.jdbc.StringJdbcQueueStore

deleteAll(Collection<Long>) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.jdbc.TypedJdbcQueueStore

deleteAll(Collection<String>) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.jdbc.StringJdbcMapStore

deleteByStatus(ProcessingStatus) - Method in class com.norconex.crawler.core.ledger.CrawlerEntryLedger

Deletes all entries with the given processing status.

deleted - Static variable in class com.norconex.crawler.core.ledger.CrawlerEntry.Fields

DELETED - Static variable in class com.norconex.crawler.core.ledger.ProcessingOutcome

DELETED_REFS_CACHE_NAME - Static variable in class com.norconex.crawler.core.event.listeners.DeleteRejectedEventListener

DeleteRejectedEventListener - Class in com.norconex.crawler.core.event.listeners

Provides the ability to send deletion requests to your configured committer(s) whenever a reference is rejected, regardless whether it was encountered in a previous crawling session or not.

DeleteRejectedEventListener() - Constructor for class com.norconex.crawler.core.event.listeners.DeleteRejectedEventListener

DeleteRejectedEventListenerConfig - Class in com.norconex.crawler.core.event.listeners

Configuration for DeleteRejectedEventListener.

DeleteRejectedEventListenerConfig() - Constructor for class com.norconex.crawler.core.event.listeners.DeleteRejectedEventListenerConfig

DeleteRequest - Class in com.norconex.committer.core

A committer deletion request.

DeleteRequest(String, Properties) - Constructor for class com.norconex.committer.core.DeleteRequest

deleteRequestBuilder(Function<T, DeleteRequest>) - Method in class com.norconex.committer.core.service.CommitterService.CommitterServiceBuilder

DeleteTransformer - Class in com.norconex.importer.handler.transformer.impl

Delete the metadata fields provided.

DeleteTransformer() - Constructor for class com.norconex.importer.handler.transformer.impl.DeleteTransformer

DeleteTransformerConfig - Class in com.norconex.importer.handler.transformer.impl

Delete the metadata fields provided.

DeleteTransformerConfig() - Constructor for class com.norconex.importer.handler.transformer.impl.DeleteTransformerConfig

Deletion requests sent once - Search tag in class com.norconex.crawler.core.event.listeners.DeleteRejectedEventListener

Section

delimiter - Static variable in class com.norconex.committer.core.fs.impl.CsvFileCommitterConfig.Fields

DENIED_READERS - Enum constant in enum class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.AclTarget

density - Static variable in class com.norconex.importer.handler.parser.impl.OcrConfig.Fields

depth - Static variable in class com.norconex.crawler.core.ledger.CrawlerEntry.Fields

depth - Static variable in class com.norconex.importer.handler.parser.impl.OcrConfig.Fields

DEPTH - Static variable in class com.norconex.crawler.core.doc.CrawlerDocMetaConstants

DepthValidationStage - Class in com.norconex.crawler.core.doc.pipelines.queue.stages

DepthValidationStage() - Constructor for class com.norconex.crawler.core.doc.pipelines.queue.stages.DepthValidationStage

deserialize(JsonParser, DeserializationContext) - Method in class com.norconex.importer.handler.condition.ConditionDeserializer

deserialize(JsonParser, DeserializationContext) - Method in class com.norconex.importer.handler.DocHandlerListDeserializer

deserializeWithType(JsonParser, DeserializationContext, TypeDeserializer) - Method in class com.norconex.importer.handler.condition.ConditionDeserializer

deserializeWithType(JsonParser, DeserializationContext, TypeDeserializer) - Method in class com.norconex.importer.handler.DocHandlerListDeserializer

destroy() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.jdbc.StringJdbcMapStore

detect(Doc) - Method in class com.norconex.importer.charset.CharsetDetector

Detects a document character using the following logic, in order:

detect(File) - Static method in class com.norconex.importer.doc.ContentTypeDetector

Detects the content type of the given file.

detect(File, String) - Static method in class com.norconex.importer.doc.ContentTypeDetector

Detects the content type of the given file.

detect(InputStream) - Method in class com.norconex.importer.charset.CharsetDetector

Detects the character encoding of an input stream.

detect(InputStream) - Static method in class com.norconex.importer.doc.ContentTypeDetector

Detects the content type from the given input stream.

detect(InputStream, String) - Static method in class com.norconex.importer.doc.ContentTypeDetector

Detects the content type from the given input stream.

detect(String) - Method in class com.norconex.importer.charset.CharsetDetector

Detects the character encoding of a string.

detectFromContent(String, InputStream, ContentType) - Method in interface com.norconex.crawler.web.doc.operations.canon.CanonicalLinkDetector

Detects from a document content the presence of a canonical URL.

detectFromContent(String, InputStream, ContentType) - Method in class com.norconex.crawler.web.doc.operations.canon.impl.GenericCanonicalLinkDetector

detectFromMetadata(String, Properties) - Method in interface com.norconex.crawler.web.doc.operations.canon.CanonicalLinkDetector

Detects from metadata gathered so far, which when invoked, is normally the HTTP header values.

detectFromMetadata(String, Properties) - Method in class com.norconex.crawler.web.doc.operations.canon.impl.GenericCanonicalLinkDetector

Difference with "maxDocuments" - Search tag in class com.norconex.crawler.core.event.listeners.StopCrawlerOnMaxEventListener

Section

DIGEST - Enum constant in enum class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthMethod

DIGEST authentication method.

DIRECTORY - Enum constant in enum class com.norconex.crawler.web.fetch.util.DocImageHandlerConfig.Target

Store image on local directory.

disabled - Static variable in class com.norconex.importer.handler.parser.impl.OcrConfig.Fields

DISABLED - Enum constant in enum class com.norconex.crawler.core.fetch.FetchDirectiveSupport

DISK - Enum constant in enum class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig.Storage

Stores the scaled image on the file system, in the format and directory specified.

doBody(DocHandlerContext) - Method in class com.norconex.importer.handler.transformer.impl.TruncateTransformer

doc(Doc) - Method in class com.norconex.crawler.core.doc.CrawlerDocContext.CrawlerDocContextBuilder

doc(Doc) - Method in class com.norconex.importer.handler.DocHandlerContext.DocHandlerContextBuilder

Doc - Class in com.norconex.importer.doc

A document being imported.

Doc(Doc) - Constructor for class com.norconex.importer.doc.Doc

Copy constructor.

Doc(String) - Constructor for class com.norconex.importer.doc.Doc

DOC_PDF_PAGE_NO - Static variable in class com.norconex.importer.handler.splitter.impl.PdfPageSplitter

DOC_PDF_TOTAL_PAGES - Static variable in class com.norconex.importer.handler.splitter.impl.PdfPageSplitter

DocHandler - Interface in com.norconex.importer.handler

Document Handler are responsible for interacting with a document to either parse it, transform it, decorate it, split it, translate it, filter it, etc.

DocHandlerContext - Class in com.norconex.importer.handler

DocHandlerContext.DocHandlerContextBuilder - Class in com.norconex.importer.handler

DocHandlerException - Exception Class in com.norconex.importer.handler

Exception thrown by handler classes upon encountering issues.

DocHandlerException() - Constructor for exception class com.norconex.importer.handler.DocHandlerException

DocHandlerException(String) - Constructor for exception class com.norconex.importer.handler.DocHandlerException

DocHandlerException(String, Throwable) - Constructor for exception class com.norconex.importer.handler.DocHandlerException

DocHandlerException(Throwable) - Constructor for exception class com.norconex.importer.handler.DocHandlerException

DocHandlerListDeserializer - Class in com.norconex.importer.handler

DocHandlerListDeserializer() - Constructor for class com.norconex.importer.handler.DocHandlerListDeserializer

DocHandlerListSerializer - Class in com.norconex.importer.handler

DocHandlerListSerializer() - Constructor for class com.norconex.importer.handler.DocHandlerListSerializer

DocImageHandler - Class in com.norconex.crawler.web.fetch.util

Handles images associated with a document (which is different than a document being itself an image).

DocImageHandler() - Constructor for class com.norconex.crawler.web.fetch.util.DocImageHandler

DocImageHandlerConfig - Class in com.norconex.crawler.web.fetch.util

Configuration for DocImageHandler.

DocImageHandlerConfig() - Constructor for class com.norconex.crawler.web.fetch.util.DocImageHandlerConfig

DocImageHandlerConfig.DirStructure - Enum Class in com.norconex.crawler.web.fetch.util

Directory structure when storing images on disk.

DocImageHandlerConfig.Target - Enum Class in com.norconex.crawler.web.fetch.util

doClean() - Method in class com.norconex.committer.core.AbstractCommitter

doClean() - Method in class com.norconex.committer.core.batch.AbstractBatchCommitter

doClean() - Method in class com.norconex.committer.core.fs.AbstractFsCommitter

doClean() - Method in class com.norconex.committer.core.impl.LogCommitter

doClean() - Method in class com.norconex.committer.core.impl.MemoryCommitter

doClose() - Method in class com.norconex.committer.core.AbstractCommitter

Subclasses can perform additional closing logic by overriding this method.

doClose() - Method in class com.norconex.committer.core.batch.AbstractBatchCommitter

doClose() - Method in class com.norconex.committer.core.fs.AbstractFsCommitter

doClose() - Method in class com.norconex.committer.core.impl.LogCommitter

doClose() - Method in class com.norconex.committer.core.impl.MemoryCommitter

DocMetaConstants - Class in com.norconex.importer.doc

Constants for common metadata field names typically associated with a document and often set on Doc.getMetadata().

docPipelines() - Method in class com.norconex.crawler.core.CrawlerDriver

docPipelines(CrawlerDocPipelines) - Method in class com.norconex.crawler.core.context.CrawlerContext.Builder

docPipelines(CrawlerDocPipelines) - Method in class com.norconex.crawler.core.CrawlerDriver.Builder

doCreateDocumentChecksum(Doc) - Method in class com.norconex.crawler.core.doc.operations.checksum.AbstractDocumentChecksummer

doCreateDocumentChecksum(Doc) - Method in class com.norconex.crawler.core.doc.operations.checksum.impl.Md5DocumentChecksummer

doCreateMetaChecksum(Properties) - Method in class com.norconex.crawler.core.doc.operations.checksum.AbstractMetadataChecksummer

doCreateMetaChecksum(Properties) - Method in class com.norconex.crawler.core.doc.operations.checksum.impl.GenericMetadataChecksummer

doCreateMetaChecksum(Properties) - Method in class com.norconex.crawler.fs.doc.operations.checksum.FsMetadataChecksummer

doCreateMetaChecksum(Properties) - Method in class com.norconex.crawler.web.doc.operations.checksum.impl.LastModifiedMetadataChecksummer

document(Doc) - Method in class com.norconex.importer.ImporterEvent.ImporterEventBuilder

Gets the document associated with this event, if applicable.

DOCUMENT - Enum constant in enum class com.norconex.crawler.core.fetch.FetchDirective

A directive to execute a fetch request for the entire document, including metadata.

DOCUMENT_FETCHED - Static variable in class com.norconex.crawler.core.event.CrawlerEvent

A document was successfully retrieved for processing.

DOCUMENT_FINALIZING_BEGIN - Static variable in class com.norconex.crawler.core.event.CrawlerEvent

Fired just before document finalization begins.

DOCUMENT_FINALIZING_END - Static variable in class com.norconex.crawler.core.event.CrawlerEvent

Fired just after document finalization ends.

DOCUMENT_IMPORTED - Static variable in class com.norconex.crawler.core.event.CrawlerEvent

A document was imported.

DOCUMENT_METADATA_FETCHED - Static variable in class com.norconex.crawler.core.event.CrawlerEvent

A document metadata fields were successfully retrieved.

DOCUMENT_POSTIMPORTED - Static variable in class com.norconex.crawler.core.event.CrawlerEvent

A document post-import processor was executed properly.

DOCUMENT_PREIMPORTED - Static variable in class com.norconex.crawler.core.event.CrawlerEvent

A document pre-import processor was executed properly.

DOCUMENT_PROCESSED - Static variable in class com.norconex.crawler.core.event.CrawlerEvent

A document was processed (successfully or not).

DOCUMENT_PROCESSING_BEGIN - Static variable in class com.norconex.crawler.core.event.CrawlerEvent

Fired just before document processing begins.

DOCUMENT_PROCESSING_END - Static variable in class com.norconex.crawler.core.event.CrawlerEvent

Fired just after document processing ends.

DOCUMENT_QUEUED - Static variable in class com.norconex.crawler.core.event.CrawlerEvent

A document reference was queued in the data store for processing.

documentChecksummer - Static variable in class com.norconex.crawler.core.CrawlerConfig.Fields

DocumentChecksummer - Interface in com.norconex.crawler.core.doc.operations.checksum

Creates a checksum representing a a document.

DocumentChecksumStage - Class in com.norconex.crawler.core.doc.pipelines.committer.stages

Common pipeline stage for creating a document checksum.

DocumentChecksumStage() - Constructor for class com.norconex.crawler.core.doc.pipelines.committer.stages.DocumentChecksumStage

DocumentConsumer - Interface in com.norconex.crawler.core.doc.operations

Optional custom processing of a document just before or just after document has been imported by the Importer module.

Document content - Search tag in class com.norconex.crawler.web.doc.operations.canon.impl.GenericCanonicalLinkDetector

Section

documentDeduplicate - Static variable in class com.norconex.crawler.core.CrawlerConfig.Fields

DocumentDedupStage - Class in com.norconex.crawler.core.doc.pipelines.committer.stages

Provided both document checksum and deduplication are enabled, verify there are no other documents with the same content checksum encountered in the same crawl session.

DocumentDedupStage() - Constructor for class com.norconex.crawler.core.doc.pipelines.committer.stages.DocumentDedupStage

documentFetchSupport - Static variable in class com.norconex.crawler.core.CrawlerConfig.Fields

DocumentFilter - Interface in com.norconex.crawler.core.doc.operations.filter

Filter a document after the document content is fetched, downloaded, or otherwise read or acquired.

documentFilters - Static variable in class com.norconex.crawler.core.CrawlerConfig.Fields

DocumentFiltersStage - Class in com.norconex.crawler.core.doc.pipelines.importer.stages

DocumentFiltersStage() - Constructor for class com.norconex.crawler.core.doc.pipelines.importer.stages.DocumentFiltersStage

Document Importing - Search tag in class com.norconex.crawler.web.WebCrawlerConfig

Section

DocumentLengthTransformer - Class in com.norconex.importer.handler.transformer.impl

Adds the document length (i.e., number of bytes) to the specified field.

DocumentLengthTransformer() - Constructor for class com.norconex.importer.handler.transformer.impl.DocumentLengthTransformer

DocumentLengthTransformerConfig - Class in com.norconex.importer.handler.transformer.impl

Adds the document length (i.e., number of bytes) to the specified field.

DocumentLengthTransformerConfig() - Constructor for class com.norconex.importer.handler.transformer.impl.DocumentLengthTransformerConfig

DocumentPostProcessingStage - Class in com.norconex.crawler.core.doc.pipelines.committer.stages

DocumentPostProcessingStage() - Constructor for class com.norconex.crawler.core.doc.pipelines.committer.stages.DocumentPostProcessingStage

DocumentPreProcessingStage - Class in com.norconex.crawler.core.doc.pipelines.importer.stages

DocumentPreProcessingStage() - Constructor for class com.norconex.crawler.core.doc.pipelines.importer.stages.DocumentPreProcessingStage

Document reference encoding - Search tag in class com.norconex.committer.azurecognitivesearch.AzureSearchCommitter

Section

doDelete(DeleteRequest) - Method in class com.norconex.committer.core.AbstractCommitter

doDelete(DeleteRequest) - Method in class com.norconex.committer.core.batch.AbstractBatchCommitter

doDelete(DeleteRequest) - Method in class com.norconex.committer.core.fs.AbstractFsCommitter

doDelete(DeleteRequest) - Method in class com.norconex.committer.core.impl.LogCommitter

doDelete(DeleteRequest) - Method in class com.norconex.committer.core.impl.MemoryCommitter

doFields(DocHandlerContext) - Method in class com.norconex.importer.handler.transformer.impl.TruncateTransformer

doInit() - Method in class com.norconex.committer.core.AbstractCommitter

Subclasses can perform additional initialization by overriding this method.

doInit() - Method in class com.norconex.committer.core.batch.AbstractBatchCommitter

doInit() - Method in class com.norconex.committer.core.fs.AbstractFsCommitter

doInit() - Method in class com.norconex.committer.core.impl.LogCommitter

doInit() - Method in class com.norconex.committer.core.impl.MemoryCommitter

DOM_CONTENT_TYPES - Static variable in class com.norconex.importer.handler.CommonMatchers

Content types representing a document object model:

domain - Static variable in class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthConfig.Fields

DomCondition - Class in com.norconex.importer.handler.condition.impl

A condition using a Document Object Model (DOM) representation of an HTML, XHTML, or XML document content to match an element, attribute or value.

DomCondition() - Constructor for class com.norconex.importer.handler.condition.impl.DomCondition

DomConditionConfig - Class in com.norconex.importer.handler.condition.impl

A condition using a Document Object Model (DOM) representation of an HTML, XHTML, or XML document content to match an element, attribute or value.

DomConditionConfig() - Constructor for class com.norconex.importer.handler.condition.impl.DomConditionConfig

domContentTypes() - Static method in class com.norconex.importer.handler.CommonMatchers

Matcher for common content-types defining a DOM document.

domContentTypes(String) - Static method in class com.norconex.importer.handler.CommonRestrictions

Common content-types defining a DOM document.

DomLinkExtractor - Class in com.norconex.crawler.web.doc.operations.link.impl

Extracts links from a Document Object Model (DOM) representation of an HTML, XHTML, or XML document content based on values of matching elements and attributes.

DomLinkExtractor() - Constructor for class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractor

DomLinkExtractorConfig - Class in com.norconex.crawler.web.doc.operations.link.impl

Configuration for DomLinkExtractor.

DomLinkExtractorConfig() - Constructor for class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractorConfig

DomLinkExtractorConfig.LinkSelector - Class in com.norconex.crawler.web.doc.operations.link.impl

DomOperation - Class in com.norconex.importer.handler.transformer.impl

DOM operation details.

DomOperation() - Constructor for class com.norconex.importer.handler.transformer.impl.DomOperation

DomSplitter - Class in com.norconex.importer.handler.splitter.impl

Splits HTML, XHTML, or XML document on elements matching a given selector.

DomSplitter() - Constructor for class com.norconex.importer.handler.splitter.impl.DomSplitter

DomSplitterConfig - Class in com.norconex.importer.handler.splitter.impl

Splits HTML, XHTML, or XML document on elements matching a given selector.

DomSplitterConfig() - Constructor for class com.norconex.importer.handler.splitter.impl.DomSplitterConfig

DomTransformer - Class in com.norconex.importer.handler.transformer.impl

Extract the value of one or more elements or attributes into a target field, or delete matching elements.

DomTransformer() - Constructor for class com.norconex.importer.handler.transformer.impl.DomTransformer

DomTransformerConfig - Class in com.norconex.importer.handler.transformer.impl

Extract the value of one or more elements or attributes into a target field, or delete matching elements.

DomTransformerConfig() - Constructor for class com.norconex.importer.handler.transformer.impl.DomTransformerConfig

DomUtil - Class in com.norconex.importer.util

Utility methods related to JSoup/DOM manipulation.

doStart() - Method in class com.norconex.crawler.core.cluster.admin.ClusterAdminServer

Dots (.) in field names - Search tag in class com.norconex.committer.elasticsearch.ElasticsearchCommitter

Section

DOUBLE - Enum constant in enum class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.StructuredDataType

doUpsert(UpsertRequest) - Method in class com.norconex.committer.core.AbstractCommitter

doUpsert(UpsertRequest) - Method in class com.norconex.committer.core.batch.AbstractBatchCommitter

doUpsert(UpsertRequest) - Method in class com.norconex.committer.core.fs.AbstractFsCommitter

doUpsert(UpsertRequest) - Method in class com.norconex.committer.core.impl.LogCommitter

doUpsert(UpsertRequest) - Method in class com.norconex.committer.core.impl.MemoryCommitter

driver() - Method in class com.norconex.crawler.core.context.CrawlerContextFactory.Builder

driver(CrawlerDriver) - Method in class com.norconex.crawler.core.context.CrawlerContextFactory.Builder

Dynamic dates: - Search tag in class com.norconex.importer.handler.condition.impl.DateProviderFactory

Section

DynamicFixedDateTimeProvider(DateCondition.TimeUnit, int, boolean, ZoneId) - Constructor for class com.norconex.importer.handler.condition.impl.DateProviderFactory.DynamicFixedDateTimeProvider

DynamicFloatingDateTimeProvider(DateCondition.TimeUnit, int, boolean, ZoneId) - Constructor for class com.norconex.importer.handler.condition.impl.DateProviderFactory.DynamicFloatingDateTimeProvider

E

EDGE - Enum constant in enum class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverBrowser

EgnyteFetcher - Class in com.norconex.crawler.fs.fetch.impl.egnyte

Egnyte API fetcher.

EgnyteFetcher() - Constructor for class com.norconex.crawler.fs.fetch.impl.egnyte.EgnyteFetcher

EgnyteFetcherConfig - Class in com.norconex.crawler.fs.fetch.impl.egnyte

Configuration for EgnyteFetcher.

EgnyteFetcherConfig() - Constructor for class com.norconex.crawler.fs.fetch.impl.egnyte.EgnyteFetcherConfig

ELASTICSEARCH_ID_FIELD - Static variable in class com.norconex.committer.elasticsearch.ElasticsearchCommitter

ElasticsearchCommitter - Class in com.norconex.committer.elasticsearch

Commits documents to Elasticsearch.

ElasticsearchCommitter() - Constructor for class com.norconex.committer.elasticsearch.ElasticsearchCommitter

ElasticsearchCommitterConfig - Class in com.norconex.committer.elasticsearch

ElasticsearchCommitterConfig() - Constructor for class com.norconex.committer.elasticsearch.ElasticsearchCommitterConfig

ElasticsearchCommitterPtProvider - Class in com.norconex.committer.elasticsearch.spi

For auto registering in BeanMapper.

ElasticsearchCommitterPtProvider() - Constructor for class com.norconex.committer.elasticsearch.spi.ElasticsearchCommitterPtProvider

Elasticsearch ID limitations: - Search tag in class com.norconex.committer.elasticsearch.ElasticsearchCommitter

Section

Element matching - Search tag in class com.norconex.importer.handler.splitter.impl.XmlStreamSplitter

Section

Element matching - Search tag in class com.norconex.importer.handler.splitter.impl.XmlStreamSplitterConfig

Section

EMBEDDED_INDEX - Static variable in class com.norconex.importer.doc.DocMetaConstants

Zero-based index of this embedded document in relation to siblings.

EMBEDDED_PARENT_REFERENCES - Static variable in class com.norconex.importer.doc.DocMetaConstants

All references to parents of an embedded document (first is top-one).

EMBEDDED_REFERENCE - Static variable in class com.norconex.importer.doc.DocMetaConstants

Relative reference to this document within its parent.

EMBEDDED_TYPE - Static variable in class com.norconex.importer.doc.DocMetaConstants

Type of embedded file (from a zip, a word doc, etc.).

EmbeddedConfig - Class in com.norconex.importer.handler.parser.impl

For documents containing embedded documents (e.g. zip files), the default behavior of this treat them as a single document, merging all embedded documents content and metadata into the parent document.

EmbeddedConfig() - Constructor for class com.norconex.importer.handler.parser.impl.EmbeddedConfig

EMPTY_RESPONSES - Static variable in class com.norconex.importer.response.ImporterResponse

enableImagePreprocessing - Static variable in class com.norconex.importer.handler.parser.impl.OcrConfig.Fields

ENCODE_NON_URI_CHARACTERS - Enum constant in enum class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizerConfig.Normalization

ENCODE_SPACES - Enum constant in enum class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizerConfig.Normalization

end - Static variable in class com.norconex.crawler.web.doc.operations.delay.impl.DelayRange.Fields

endsWith(String) - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyPath

endsWith(Path) - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyPath

enqueue(QueueBootstrapContext) - Method in interface com.norconex.crawler.core.cmd.crawl.pipeline.bootstrap.queue.ReferenceEnqueuer

enqueue(QueueBootstrapContext) - Method in class com.norconex.crawler.core.cmd.crawl.pipeline.bootstrap.queue.RefFileEnqueuer

enqueue(QueueBootstrapContext) - Method in class com.norconex.crawler.core.cmd.crawl.pipeline.bootstrap.queue.RefListEnqueuer

enqueue(QueueBootstrapContext) - Method in class com.norconex.crawler.core.cmd.crawl.pipeline.bootstrap.queue.RefProviderEnqueuer

enqueue(QueueBootstrapContext) - Method in class com.norconex.crawler.web.doc.pipelines.queue.SitemapEnqueuer

ensureCurrentLedgerAliasExists() - Method in class com.norconex.crawler.core.ledger.CrawlerEntryLedger

Ensures the current ledger alias exists in session cache.

ensureTableExists(String, List<String>) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.jdbc.JdbcClient

Ensures the table exists, using a cross-database approach: Try CREATE TABLE ...

entryAdded(EntryEvent<String, T>) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.event.CacheEntryChangeListenerAdapter

entryUpdated(EntryEvent<String, T>) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.event.CacheEntryChangeListenerAdapter

ENUM - Enum constant in enum class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.StructuredDataType

equals(Object) - Method in class com.norconex.committer.amazoncloudsearch.AmazonCloudSearchCommitter

equals(Object) - Method in class com.norconex.committer.amazoncloudsearch.AmazonCloudSearchCommitterConfig

equals(Object) - Method in class com.norconex.committer.apachekafka.ApacheKafkaCommitter

equals(Object) - Method in class com.norconex.committer.apachekafka.ApacheKafkaCommitterConfig

equals(Object) - Method in class com.norconex.committer.azurecognitivesearch.AzureSearchCommitter

equals(Object) - Method in class com.norconex.committer.azurecognitivesearch.AzureSearchCommitterConfig

equals(Object) - Method in class com.norconex.committer.core.AbstractCommitter

equals(Object) - Method in class com.norconex.committer.core.BaseCommitterConfig

equals(Object) - Method in class com.norconex.committer.core.batch.AbstractBatchCommitter

equals(Object) - Method in class com.norconex.committer.core.batch.BaseBatchCommitterConfig

equals(Object) - Method in class com.norconex.committer.core.batch.queue.impl.FsQueue

equals(Object) - Method in class com.norconex.committer.core.batch.queue.impl.FsQueueConfig

equals(Object) - Method in class com.norconex.committer.core.batch.queue.impl.FsQueueConfig.OnCommitFailure

equals(Object) - Method in class com.norconex.committer.core.CommitterContext

equals(Object) - Method in class com.norconex.committer.core.CommitterEvent

equals(Object) - Method in class com.norconex.committer.core.DeleteRequest

equals(Object) - Method in class com.norconex.committer.core.fs.AbstractFsCommitter

equals(Object) - Method in class com.norconex.committer.core.fs.BaseFsCommitterConfig

equals(Object) - Method in class com.norconex.committer.core.fs.impl.CsvColumn

equals(Object) - Method in class com.norconex.committer.core.fs.impl.CsvFileCommitter

equals(Object) - Method in class com.norconex.committer.core.fs.impl.CsvFileCommitterConfig

equals(Object) - Method in class com.norconex.committer.core.fs.impl.JsonFileCommitter

equals(Object) - Method in class com.norconex.committer.core.fs.impl.JsonFileCommitterConfig

equals(Object) - Method in class com.norconex.committer.core.fs.impl.XmlFileCommitter

equals(Object) - Method in class com.norconex.committer.core.fs.impl.XmlFileCommitterConfig

equals(Object) - Method in class com.norconex.committer.core.impl.LogCommitter

equals(Object) - Method in class com.norconex.committer.core.impl.LogCommitterConfig

equals(Object) - Method in class com.norconex.committer.core.impl.MemoryCommitter

equals(Object) - Method in class com.norconex.committer.core.impl.MemoryCommitterConfig

equals(Object) - Method in class com.norconex.committer.core.service.CommitterService

equals(Object) - Method in class com.norconex.committer.core.service.CommitterServiceEvent

equals(Object) - Method in class com.norconex.committer.core.UpsertRequest

equals(Object) - Method in class com.norconex.committer.elasticsearch.ElasticsearchCommitter

equals(Object) - Method in class com.norconex.committer.elasticsearch.ElasticsearchCommitterConfig

equals(Object) - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitter

equals(Object) - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.AclInheritanceMapping

equals(Object) - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.AclMapping

equals(Object) - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig

equals(Object) - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.MetadataMapping

equals(Object) - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.StructuredDataMapping

equals(Object) - Method in class com.norconex.committer.idol.IdolCommitter

equals(Object) - Method in class com.norconex.committer.idol.IdolCommitterConfig

equals(Object) - Method in class com.norconex.committer.neo4j.Neo4jCommitter

equals(Object) - Method in class com.norconex.committer.neo4j.Neo4jCommitterConfig

equals(Object) - Method in class com.norconex.committer.solr.SolrCommitter

equals(Object) - Method in class com.norconex.committer.solr.SolrCommitterConfig

equals(Object) - Method in class com.norconex.committer.sql.SqlCommitter

equals(Object) - Method in class com.norconex.committer.sql.SqlCommitterConfig

equals(Object) - Method in class com.norconex.crawler.core.cli.CliBase

equals(Object) - Method in class com.norconex.crawler.core.cli.CliConfigRender

equals(Object) - Method in class com.norconex.crawler.core.cli.CliRunner

equals(Object) - Method in class com.norconex.crawler.core.cli.CliStart

equals(Object) - Method in class com.norconex.crawler.core.cli.CliStop

equals(Object) - Method in class com.norconex.crawler.core.cli.CliStoreExport

equals(Object) - Method in class com.norconex.crawler.core.cli.CliStoreImport

equals(Object) - Method in class com.norconex.crawler.core.cluster.ClusterConfig

equals(Object) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastCluster

equals(Object) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastClusterConnector

equals(Object) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastClusterConnectorConfig

equals(Object) - Method in record class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastConfigurerContext

Indicates whether some other object is "equal to" this one.

equals(Object) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.JdbcHazelcastConfigurer

equals(Object) - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreClusterConnector

equals(Object) - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreClusterConnectorConfig

equals(Object) - Method in class com.norconex.crawler.core.cluster.pipeline.BaseStep

equals(Object) - Method in class com.norconex.crawler.core.cluster.pipeline.Pipeline

equals(Object) - Method in class com.norconex.crawler.core.cluster.pipeline.PipelineProgress

equals(Object) - Method in class com.norconex.crawler.core.cluster.pipeline.PipelineResult

equals(Object) - Method in class com.norconex.crawler.core.cluster.pipeline.Step.StepProgress

equals(Object) - Method in class com.norconex.crawler.core.cluster.pipeline.StepRecord

equals(Object) - Method in class com.norconex.crawler.core.cluster.QueryFilter

equals(Object) - Method in class com.norconex.crawler.core.cluster.SerializedCache

equals(Object) - Method in class com.norconex.crawler.core.cluster.SerializedCache.SerializedEntry

equals(Object) - Method in class com.norconex.crawler.core.cluster.SerializedRecord

equals(Object) - Method in class com.norconex.crawler.core.cmd.crawl.CrawlerProgressLogger

equals(Object) - Method in class com.norconex.crawler.core.cmd.crawl.pipeline.bootstrap.queue.QueueBootstrapper

equals(Object) - Method in class com.norconex.crawler.core.cmd.crawl.pipeline.process.CrawlerProcessStep

equals(Object) - Method in class com.norconex.crawler.core.context.CrawlerContext

equals(Object) - Method in class com.norconex.crawler.core.context.CrawlerContextFactory.Builder

equals(Object) - Method in class com.norconex.crawler.core.CrawlerConfig

equals(Object) - Method in class com.norconex.crawler.core.CrawlerDriver.FetchDriver

equals(Object) - Method in class com.norconex.crawler.core.doc.operations.checksum.AbstractDocumentChecksummer

equals(Object) - Method in class com.norconex.crawler.core.doc.operations.checksum.AbstractMetadataChecksummer

equals(Object) - Method in class com.norconex.crawler.core.doc.operations.checksum.BaseChecksummerConfig

equals(Object) - Method in class com.norconex.crawler.core.doc.operations.checksum.impl.GenericMetadataChecksummer

equals(Object) - Method in class com.norconex.crawler.core.doc.operations.checksum.impl.GenericMetadataChecksummerConfig

equals(Object) - Method in class com.norconex.crawler.core.doc.operations.checksum.impl.Md5DocumentChecksummer

equals(Object) - Method in class com.norconex.crawler.core.doc.operations.checksum.impl.Md5DocumentChecksummerConfig

equals(Object) - Method in class com.norconex.crawler.core.doc.operations.filter.impl.ExtensionReferenceFilter

equals(Object) - Method in class com.norconex.crawler.core.doc.operations.filter.impl.ExtensionReferenceFilterConfig

equals(Object) - Method in class com.norconex.crawler.core.doc.operations.filter.impl.GenericMetadataFilter

equals(Object) - Method in class com.norconex.crawler.core.doc.operations.filter.impl.GenericMetadataFilterConfig

equals(Object) - Method in class com.norconex.crawler.core.doc.operations.filter.impl.GenericReferenceFilter

equals(Object) - Method in class com.norconex.crawler.core.doc.operations.filter.impl.GenericReferenceFilterConfig

equals(Object) - Method in class com.norconex.crawler.core.doc.operations.spoil.impl.GenericSpoiledReferenceStrategizer

equals(Object) - Method in class com.norconex.crawler.core.doc.operations.spoil.impl.GenericSpoiledReferenceStrategizerConfig

equals(Object) - Method in class com.norconex.crawler.core.doc.pipelines.committer.CommitterPipelineContext

equals(Object) - Method in class com.norconex.crawler.core.doc.pipelines.importer.ImporterPipelineContext

equals(Object) - Method in class com.norconex.crawler.core.doc.pipelines.queue.QueuePipelineContext

equals(Object) - Method in class com.norconex.crawler.core.event.CrawlerEvent

equals(Object) - Method in class com.norconex.crawler.core.event.listeners.CrawlerLifeCycleListener

equals(Object) - Method in class com.norconex.crawler.core.event.listeners.DeleteRejectedEventListener

equals(Object) - Method in class com.norconex.crawler.core.event.listeners.DeleteRejectedEventListenerConfig

equals(Object) - Method in class com.norconex.crawler.core.event.listeners.StopCrawlerOnMaxEventListener

equals(Object) - Method in class com.norconex.crawler.core.event.listeners.StopCrawlerOnMaxEventListenerConfig

equals(Object) - Method in class com.norconex.crawler.core.fetch.AbstractFetcher

equals(Object) - Method in class com.norconex.crawler.core.fetch.AggregatedFetchResponse

equals(Object) - Method in class com.norconex.crawler.core.fetch.BaseFetcherConfig

equals(Object) - Method in class com.norconex.crawler.core.ledger.CrawlerEntry

equals(Object) - Method in class com.norconex.crawler.core.ledger.ProcessingOutcome

equals(Object) - Method in class com.norconex.crawler.core.session.CrawlerRunInfo

equals(Object) - Method in class com.norconex.crawler.core.session.CrawlerSession.State

equals(Object) - Method in class com.norconex.crawler.fs.doc.operations.checksum.FsMetadataChecksummer

equals(Object) - Method in class com.norconex.crawler.fs.fetch.AggregatedFileFetchResponse

equals(Object) - Method in class com.norconex.crawler.fs.fetch.AggregatedFolderPathsResponse

equals(Object) - Method in class com.norconex.crawler.fs.fetch.FileFetchRequest

equals(Object) - Method in class com.norconex.crawler.fs.fetch.FolderPathsFetchRequest

equals(Object) - Method in class com.norconex.crawler.fs.fetch.FsPath

equals(Object) - Method in class com.norconex.crawler.fs.fetch.impl.AbstractNioFetcher

equals(Object) - Method in class com.norconex.crawler.fs.fetch.impl.adlsgen2.AdlsGen2Fetcher

equals(Object) - Method in class com.norconex.crawler.fs.fetch.impl.adlsgen2.AdlsGen2FetcherConfig

equals(Object) - Method in class com.norconex.crawler.fs.fetch.impl.archive.ArchiveFetcher

equals(Object) - Method in class com.norconex.crawler.fs.fetch.impl.archive.ArchiveFetcherConfig

equals(Object) - Method in class com.norconex.crawler.fs.fetch.impl.azureblob.AzureBlobFetcher

equals(Object) - Method in class com.norconex.crawler.fs.fetch.impl.azureblob.AzureBlobFetcherConfig

equals(Object) - Method in class com.norconex.crawler.fs.fetch.impl.BaseAuthNioFetcherConfig

equals(Object) - Method in class com.norconex.crawler.fs.fetch.impl.box.BoxFetcher

equals(Object) - Method in class com.norconex.crawler.fs.fetch.impl.box.BoxFetcherConfig

equals(Object) - Method in class com.norconex.crawler.fs.fetch.impl.cmis.CmisAtomSession

equals(Object) - Method in class com.norconex.crawler.fs.fetch.impl.cmis.CmisFetcher

equals(Object) - Method in class com.norconex.crawler.fs.fetch.impl.cmis.CmisFetcherConfig

equals(Object) - Method in class com.norconex.crawler.fs.fetch.impl.egnyte.EgnyteFetcher

equals(Object) - Method in class com.norconex.crawler.fs.fetch.impl.egnyte.EgnyteFetcherConfig

equals(Object) - Method in record class com.norconex.crawler.fs.fetch.impl.FolderItemReferenceParser.Parsed

Indicates whether some other object is "equal to" this one.

equals(Object) - Method in class com.norconex.crawler.fs.fetch.impl.ftp.FtpFetcher

equals(Object) - Method in class com.norconex.crawler.fs.fetch.impl.ftp.FtpFetcherConfig

equals(Object) - Method in class com.norconex.crawler.fs.fetch.impl.gcs.GcsFetcher

equals(Object) - Method in class com.norconex.crawler.fs.fetch.impl.gcs.GcsFetcherConfig

equals(Object) - Method in class com.norconex.crawler.fs.fetch.impl.GenericFileFetchResponse

equals(Object) - Method in class com.norconex.crawler.fs.fetch.impl.GenericFolderPathsFetchResponse

equals(Object) - Method in class com.norconex.crawler.fs.fetch.impl.googledrive.GoogleDriveFetcher

equals(Object) - Method in class com.norconex.crawler.fs.fetch.impl.googledrive.GoogleDriveFetcherConfig

equals(Object) - Method in class com.norconex.crawler.fs.fetch.impl.hdfs.HdfsFetcher

equals(Object) - Method in class com.norconex.crawler.fs.fetch.impl.hdfs.HdfsFetcherConfig

equals(Object) - Method in class com.norconex.crawler.fs.fetch.impl.hdfs.KerberosConfig

equals(Object) - Method in class com.norconex.crawler.fs.fetch.impl.local.LocalFetcher

equals(Object) - Method in class com.norconex.crawler.fs.fetch.impl.local.LocalFetcherConfig

equals(Object) - Method in class com.norconex.crawler.fs.fetch.impl.m365graph.M365GraphFetcher

equals(Object) - Method in class com.norconex.crawler.fs.fetch.impl.m365graph.M365GraphFetcherConfig

equals(Object) - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyPath

equals(Object) - Method in class com.norconex.crawler.fs.fetch.impl.s3.S3Fetcher

equals(Object) - Method in class com.norconex.crawler.fs.fetch.impl.s3.S3FetcherConfig

equals(Object) - Method in class com.norconex.crawler.fs.fetch.impl.sftp.SftpFetcher

equals(Object) - Method in class com.norconex.crawler.fs.fetch.impl.sftp.SftpFetcherConfig

equals(Object) - Method in class com.norconex.crawler.fs.fetch.impl.smb.SmbFetcher

equals(Object) - Method in class com.norconex.crawler.fs.fetch.impl.smb.SmbFetcherConfig

equals(Object) - Method in class com.norconex.crawler.fs.fetch.impl.webdav.WebDavFetcher

equals(Object) - Method in class com.norconex.crawler.fs.fetch.impl.webdav.WebDavFetcherConfig

equals(Object) - Method in class com.norconex.crawler.fs.ledger.FsCrawlerEntry

equals(Object) - Method in class com.norconex.crawler.web.doc.operations.canon.impl.GenericCanonicalLinkDetector

equals(Object) - Method in class com.norconex.crawler.web.doc.operations.canon.impl.GenericCanonicalLinkDetectorConfig

equals(Object) - Method in class com.norconex.crawler.web.doc.operations.checksum.impl.LastModifiedMetadataChecksummer

equals(Object) - Method in class com.norconex.crawler.web.doc.operations.delay.impl.AbstractDelay

equals(Object) - Method in class com.norconex.crawler.web.doc.operations.delay.impl.AbstractDelayResolver

equals(Object) - Method in class com.norconex.crawler.web.doc.operations.delay.impl.BaseDelayResolverConfig

equals(Object) - Method in class com.norconex.crawler.web.doc.operations.delay.impl.CrawlerDelay

equals(Object) - Method in class com.norconex.crawler.web.doc.operations.delay.impl.DelayRange

equals(Object) - Method in class com.norconex.crawler.web.doc.operations.delay.impl.DelayReferencePattern

equals(Object) - Method in class com.norconex.crawler.web.doc.operations.delay.impl.DelaySchedule

equals(Object) - Method in class com.norconex.crawler.web.doc.operations.delay.impl.GenericDelayResolver

equals(Object) - Method in class com.norconex.crawler.web.doc.operations.delay.impl.GenericDelayResolverConfig

equals(Object) - Method in class com.norconex.crawler.web.doc.operations.delay.impl.ReferenceDelayResolver

equals(Object) - Method in class com.norconex.crawler.web.doc.operations.delay.impl.ReferenceDelayResolverConfig

equals(Object) - Method in class com.norconex.crawler.web.doc.operations.delay.impl.SiteDelay

equals(Object) - Method in class com.norconex.crawler.web.doc.operations.filter.impl.SegmentCountUrlFilter

equals(Object) - Method in class com.norconex.crawler.web.doc.operations.filter.impl.SegmentCountUrlFilterConfig

equals(Object) - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImage

equals(Object) - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolver

equals(Object) - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig

equals(Object) - Method in class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractor

equals(Object) - Method in class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractorConfig

equals(Object) - Method in class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractorConfig.LinkSelector

equals(Object) - Method in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractor

equals(Object) - Method in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractorConfig

equals(Object) - Method in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractorConfig.RegexPair

equals(Object) - Method in class com.norconex.crawler.web.doc.operations.link.impl.RegexLinkExtractor

equals(Object) - Method in class com.norconex.crawler.web.doc.operations.link.impl.RegexLinkExtractorConfig

equals(Object) - Method in class com.norconex.crawler.web.doc.operations.link.impl.RegexLinkExtractorConfig.ExtractionPattern

equals(Object) - Method in class com.norconex.crawler.web.doc.operations.link.impl.TikaLinkExtractor

equals(Object) - Method in class com.norconex.crawler.web.doc.operations.link.impl.TikaLinkExtractorConfig

equals(Object) - Method in class com.norconex.crawler.web.doc.operations.link.impl.XmlFeedLinkExtractor

equals(Object) - Method in class com.norconex.crawler.web.doc.operations.link.impl.XmlFeedLinkExtractorConfig

equals(Object) - Method in class com.norconex.crawler.web.doc.operations.link.Link

equals(Object) - Method in class com.norconex.crawler.web.doc.operations.recrawl.impl.GenericRecrawlableResolver

equals(Object) - Method in class com.norconex.crawler.web.doc.operations.recrawl.impl.GenericRecrawlableResolverConfig

equals(Object) - Method in class com.norconex.crawler.web.doc.operations.recrawl.impl.GenericRecrawlableResolverConfig.MinFrequency

equals(Object) - Method in class com.norconex.crawler.web.doc.operations.robot.impl.StandardRobotsMetaProvider

equals(Object) - Method in class com.norconex.crawler.web.doc.operations.robot.impl.StandardRobotsMetaProviderConfig

equals(Object) - Method in class com.norconex.crawler.web.doc.operations.robot.impl.StandardRobotsTxtProvider

equals(Object) - Method in class com.norconex.crawler.web.doc.operations.robot.RobotsMeta

equals(Object) - Method in class com.norconex.crawler.web.doc.operations.robot.RobotsTxt

equals(Object) - Method in class com.norconex.crawler.web.doc.operations.scope.impl.GenericUrlScopeResolver

equals(Object) - Method in class com.norconex.crawler.web.doc.operations.scope.impl.GenericUrlScopeResolverConfig

equals(Object) - Method in class com.norconex.crawler.web.doc.operations.sitemap.impl.GenericSitemapLocator

equals(Object) - Method in class com.norconex.crawler.web.doc.operations.sitemap.impl.GenericSitemapLocatorConfig

equals(Object) - Method in class com.norconex.crawler.web.doc.operations.sitemap.impl.GenericSitemapResolver

equals(Object) - Method in class com.norconex.crawler.web.doc.operations.sitemap.impl.GenericSitemapResolverConfig

equals(Object) - Method in class com.norconex.crawler.web.doc.operations.sitemap.SitemapContext

equals(Object) - Method in class com.norconex.crawler.web.doc.operations.sitemap.SitemapRecord

equals(Object) - Method in class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizer

equals(Object) - Method in class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizerConfig

equals(Object) - Method in class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizerConfig.NormalizationReplace

equals(Object) - Method in class com.norconex.crawler.web.doc.pipelines.importer.WebImporterPipelineContext

equals(Object) - Method in class com.norconex.crawler.web.event.listeners.UrlStatusCrawlerEventListener

equals(Object) - Method in class com.norconex.crawler.web.event.listeners.UrlStatusCrawlerEventListenerConfig

equals(Object) - Method in class com.norconex.crawler.web.fetch.AggregatedWebFetchResponse

equals(Object) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthConfig

equals(Object) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcher

equals(Object) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

equals(Object) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetchResponse

equals(Object) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.KerberosConfig

equals(Object) - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcher

equals(Object) - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcherConfig

equals(Object) - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightScreenshotHandler

equals(Object) - Method in class com.norconex.crawler.web.fetch.impl.webdriver.HttpSniffer

equals(Object) - Method in class com.norconex.crawler.web.fetch.impl.webdriver.HttpSnifferConfig

equals(Object) - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcher

equals(Object) - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig

equals(Object) - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverScreenshotHandler

equals(Object) - Method in class com.norconex.crawler.web.fetch.util.AbstractScreenshotHandler

equals(Object) - Method in class com.norconex.crawler.web.fetch.util.DocImageHandler

equals(Object) - Method in class com.norconex.crawler.web.fetch.util.DocImageHandlerConfig

equals(Object) - Method in class com.norconex.crawler.web.fetch.util.GenericRedirectUrlProvider

equals(Object) - Method in class com.norconex.crawler.web.fetch.util.GenericRedirectUrlProviderConfig

equals(Object) - Method in class com.norconex.crawler.web.fetch.util.ScreenshotHandlerConfig

equals(Object) - Method in class com.norconex.crawler.web.fetch.WebFetchRequest

equals(Object) - Method in class com.norconex.crawler.web.ledger.WebCrawlerEntry

equals(Object) - Method in class com.norconex.crawler.web.WebCrawlerConfig

equals(Object) - Method in class com.norconex.importer.charset.CharsetDetector.CharsetDetectorBuilder

equals(Object) - Method in class com.norconex.importer.doc.Doc

equals(Object) - Method in class com.norconex.importer.handler.BaseLabelableConfig

equals(Object) - Method in class com.norconex.importer.handler.condition.AllOf

equals(Object) - Method in class com.norconex.importer.handler.condition.AnyOf

equals(Object) - Method in class com.norconex.importer.handler.condition.ConditionalDocHandler

equals(Object) - Method in class com.norconex.importer.handler.condition.ConditionGroup

equals(Object) - Method in class com.norconex.importer.handler.condition.impl.BlankCondition

equals(Object) - Method in class com.norconex.importer.handler.condition.impl.BlankConditionConfig

equals(Object) - Method in class com.norconex.importer.handler.condition.impl.DateCondition

equals(Object) - Method in class com.norconex.importer.handler.condition.impl.DateConditionConfig

equals(Object) - Method in class com.norconex.importer.handler.condition.impl.DateProviderFactory.DynamicFixedDateTimeProvider

equals(Object) - Method in class com.norconex.importer.handler.condition.impl.DateProviderFactory.DynamicFloatingDateTimeProvider

equals(Object) - Method in class com.norconex.importer.handler.condition.impl.DateProviderFactory.StaticDateTimeProvider

equals(Object) - Method in class com.norconex.importer.handler.condition.impl.DateValueMatcher

equals(Object) - Method in class com.norconex.importer.handler.condition.impl.DomCondition

equals(Object) - Method in class com.norconex.importer.handler.condition.impl.DomConditionConfig

equals(Object) - Method in class com.norconex.importer.handler.condition.impl.NumericCondition

equals(Object) - Method in class com.norconex.importer.handler.condition.impl.NumericConditionConfig

equals(Object) - Method in class com.norconex.importer.handler.condition.impl.NumericValueMatcher

equals(Object) - Method in class com.norconex.importer.handler.condition.impl.ReferenceCondition

equals(Object) - Method in class com.norconex.importer.handler.condition.impl.ReferenceConditionConfig

equals(Object) - Method in class com.norconex.importer.handler.condition.impl.ScriptCondition

equals(Object) - Method in class com.norconex.importer.handler.condition.impl.ScriptConditionConfig

equals(Object) - Method in class com.norconex.importer.handler.condition.impl.TextCondition

equals(Object) - Method in class com.norconex.importer.handler.condition.impl.TextConditionConfig

equals(Object) - Method in class com.norconex.importer.handler.condition.NoneOf

equals(Object) - Method in class com.norconex.importer.handler.DocHandlerContext

equals(Object) - Method in class com.norconex.importer.handler.parser.impl.DefaultParser

equals(Object) - Method in class com.norconex.importer.handler.parser.impl.DefaultParserConfig

equals(Object) - Method in class com.norconex.importer.handler.parser.impl.EmbeddedConfig

equals(Object) - Method in class com.norconex.importer.handler.parser.impl.ExternalParser

equals(Object) - Method in class com.norconex.importer.handler.parser.impl.GrobidConfig

equals(Object) - Method in class com.norconex.importer.handler.parser.impl.OcrConfig

equals(Object) - Method in class com.norconex.importer.handler.parser.impl.SentimentConfig

equals(Object) - Method in class com.norconex.importer.handler.parser.impl.TikaParser

equals(Object) - Method in class com.norconex.importer.handler.parser.impl.TikaParserConfig

equals(Object) - Method in class com.norconex.importer.handler.Reject

equals(Object) - Method in class com.norconex.importer.handler.RejectConfig

equals(Object) - Method in class com.norconex.importer.handler.ScriptRunner

equals(Object) - Method in class com.norconex.importer.handler.splitter.AbstractDocumentSplitter

equals(Object) - Method in class com.norconex.importer.handler.splitter.BaseDocumentSplitterConfig

equals(Object) - Method in class com.norconex.importer.handler.splitter.impl.CsvSplitter

equals(Object) - Method in class com.norconex.importer.handler.splitter.impl.CsvSplitterConfig

equals(Object) - Method in class com.norconex.importer.handler.splitter.impl.DomSplitter

equals(Object) - Method in class com.norconex.importer.handler.splitter.impl.DomSplitterConfig

equals(Object) - Method in class com.norconex.importer.handler.splitter.impl.PdfPageSplitter

equals(Object) - Method in class com.norconex.importer.handler.splitter.impl.PdfPageSplitterConfig

equals(Object) - Method in class com.norconex.importer.handler.splitter.impl.TranslatorSplitter

equals(Object) - Method in class com.norconex.importer.handler.splitter.impl.TranslatorSplitterConfig

equals(Object) - Method in class com.norconex.importer.handler.splitter.impl.XmlStreamSplitter

equals(Object) - Method in class com.norconex.importer.handler.splitter.impl.XmlStreamSplitterConfig

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.BinaryContentTransformer

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.BinaryContentTransformerConfig

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.CharacterCaseTransformer

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.CharacterCaseTransformerConfig

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.CharsetTransformer

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.CharsetTransformerConfig

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.CollapseRepeatingTransformer

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.CollapseRepeatingTransformerConfig

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.Constant

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.ConstantTransformer

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.ConstantTransformerConfig

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.CopyOperation

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.CopyTransformer

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.CopyTransformerConfig

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.CountMatchesTransformer

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.CountMatchesTransformerConfig

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.CurrentDateTransformer

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.CurrentDateTransformerConfig

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.DateFormatTransformer

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.DateFormatTransformerConfig

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.DebugTransformer

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.DebugTransformerConfig

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.DeleteTransformer

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.DeleteTransformerConfig

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.DocumentLengthTransformer

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.DocumentLengthTransformerConfig

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.DomOperation

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.DomTransformer

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.DomTransformerConfig

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.ExternalTransformer

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.ExternalTransformerConfig

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.FieldReportTransformer

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.FieldReportTransformerConfig

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.ForceSingleValueTransformer

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.ForceSingleValueTransformerConfig

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.HierarchyOperation

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.HierarchyTransformer

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.HierarchyTransformerConfig

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.ImageTransformer

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.ImageTransformerConfig.Crop

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.ImageTransformerConfig

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.ImageTransformerConfig.Scale

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.KeepOnlyTransformer

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.KeepOnlyTransformerConfig

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.LanguageTransformer

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.LanguageTransformerConfig

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.MergeOperation

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.MergeTransformer

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.MergeTransformerConfig

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.RegexTransformer

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.RegexTransformerConfig

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.RenameOperation

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.RenameTransformer

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.RenameTransformerConfig

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.ReplaceOperation

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.ReplaceTransformer

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.ReplaceTransformerConfig

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.SaveDocumentTransformer

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.SaveDocumentTransformerConfig

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.ScriptTransformer

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.ScriptTransformerConfig

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.SplitOperation

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.SplitTransformer

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.SplitTransformerConfig

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.StripAfterTransformer

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.StripAfterTransformerConfig

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.StripBeforeTransformer

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.StripBeforeTransformerConfig

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.StripBetweenOperation

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.StripBetweenTransformer

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.StripBetweenTransformerConfig

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.SubstringTransformer

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.SubstringTransformerConfig

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.TextBetweenOperation

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.TextBetweenTransformer

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.TextBetweenTransformerConfig

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.TextStatisticsTransformer

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.TextStatisticsTransformerConfig

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.TitleGeneratorTransformer

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.TitleGeneratorTransformerConfig

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.TruncateTransformer

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.TruncateTransformerConfig

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.UrlExtractorTransformer

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.UrlExtractorTransformerConfig

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.UuidTransformer

equals(Object) - Method in class com.norconex.importer.handler.transformer.impl.UuidTransformerConfig

equals(Object) - Method in class com.norconex.importer.Importer

equals(Object) - Method in class com.norconex.importer.ImporterConfig

equals(Object) - Method in class com.norconex.importer.ImporterEvent

equals(Object) - Method in class com.norconex.importer.ImporterRequest

equals(Object) - Method in class com.norconex.importer.response.ImporterResponse

equals(Object) - Method in class com.norconex.importer.util.chunk.TextChunk

equals(Object) - Method in class com.norconex.importer.util.ReadAdapter.ChunkedReadOptions

err() - Method in class com.norconex.crawler.core.cli.CliBase

ERROR - Enum constant in enum class com.norconex.committer.core.impl.LogCommitterConfig.LogLevel

ERROR - Enum constant in enum class com.norconex.importer.response.ImporterResponse.Status

ERROR - Static variable in class com.norconex.crawler.core.ledger.ProcessingOutcome

Error Handling - Search tag in class com.norconex.crawler.web.WebCrawlerConfig

Section

escape - Static variable in class com.norconex.committer.core.fs.impl.CsvFileCommitterConfig.Fields

Escaping - Search tag in class com.norconex.importer.handler.ScriptRunner

Section

eval(Consumer<Bindings>) - Method in class com.norconex.importer.handler.ScriptRunner

eventListeners - Static variable in class com.norconex.crawler.core.CrawlerConfig.Fields

eventManager() - Method in class com.norconex.crawler.core.CrawlerDriver

eventManager() - Method in class com.norconex.importer.handler.DocHandlerContext

eventManager(EventManager) - Method in class com.norconex.importer.handler.DocHandlerContext.DocHandlerContextBuilder

eventManager(EventManager) - Method in class com.norconex.committer.core.service.CommitterService.CommitterServiceBuilder

eventManager(EventManager) - Method in class com.norconex.crawler.core.context.CrawlerContext.Builder

eventManager(EventManager) - Method in class com.norconex.crawler.core.CrawlerDriver.Builder

Example URIs - Search tag in class com.norconex.crawler.fs.fetch.impl.archive.ArchiveFetcher

Section

EXCEL - Enum constant in enum class com.norconex.committer.core.fs.impl.CsvFileCommitterConfig.CsvFormat

exception(Exception) - Method in class com.norconex.crawler.fs.fetch.impl.GenericFileFetchResponse.GenericFileFetchResponseBuilder

exception(Exception) - Method in class com.norconex.crawler.fs.fetch.impl.GenericFolderPathsFetchResponse.GenericFolderPathsFetchResponseBuilder

exception(Exception) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetchResponse.HttpClientFetchResponseBuilder

ExceptionSwallower - Class in com.norconex.crawler.core.util

EXCLUDE - Enum constant in enum class com.norconex.crawler.core.doc.operations.filter.OnMatch

excludeIfNull(OnMatch) - Static method in enum class com.norconex.crawler.core.doc.operations.filter.OnMatch

execute() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.pipeline.PipelineExecution

execute(CrawlerSession) - Method in interface com.norconex.crawler.core.cluster.pipeline.Step

execute(CrawlerSession) - Method in class com.norconex.crawler.core.cmd.clean.CleanCommand

execute(CrawlerSession) - Method in interface com.norconex.crawler.core.cmd.Command

execute(CrawlerSession) - Method in class com.norconex.crawler.core.cmd.crawl.CrawlerCommand

execute(CrawlerSession) - Method in class com.norconex.crawler.core.cmd.crawl.pipeline.bootstrap.queue.StartRefsQueueStep

execute(CrawlerSession) - Method in class com.norconex.crawler.core.cmd.crawl.pipeline.orphans.RequeueOrphansForDeletionStep

execute(CrawlerSession) - Method in class com.norconex.crawler.core.cmd.crawl.pipeline.orphans.RequeueOrphansForProcessingStep

execute(CrawlerSession) - Method in class com.norconex.crawler.core.cmd.crawl.pipeline.process.CrawlerProcessStep

execute(CrawlerSession) - Method in class com.norconex.crawler.core.cmd.storeexport.StoreExportCommand

execute(CrawlerSession) - Method in class com.norconex.crawler.core.cmd.storeimport.StoreImportCommand

executeDocHandler(DocHandler) - Method in class com.norconex.importer.handler.DocHandlerContext

Executes a document handler taking care of firing proper events and passing it this context as well as assigning the handler to "rejectedBy" in case of rejection.

executeInTransaction(JdbcClient.SQLTask) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.jdbc.JdbcClient

executePipeline(Pipeline) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.pipeline.HazelcastPipelineManager

executePipeline(Pipeline) - Method in class com.norconex.crawler.core.cluster.impl.memory.LocalPipelineManager

executePipeline(Pipeline) - Method in interface com.norconex.crawler.core.cluster.pipeline.PipelineManager

Executes a pipeline.

executeStage(ImporterPipelineContext) - Method in class com.norconex.crawler.core.doc.pipelines.importer.stages.AbstractImporterStage

executeStage(ImporterPipelineContext) - Method in class com.norconex.crawler.core.doc.pipelines.importer.stages.DocumentPreProcessingStage

executeStage(ImporterPipelineContext) - Method in class com.norconex.crawler.core.doc.pipelines.importer.stages.MetadataChecksumStage

executeStage(ImporterPipelineContext) - Method in class com.norconex.crawler.core.doc.pipelines.importer.stages.MetadataDedupStage

executeStage(ImporterPipelineContext) - Method in class com.norconex.crawler.core.doc.pipelines.importer.stages.MetadataFiltersStage

executeStage(ImporterPipelineContext) - Method in class com.norconex.crawler.fs.doc.pipelines.importer.stages.FileFetchStage

Only does something if appropriate.

executeStage(ImporterPipelineContext) - Method in class com.norconex.crawler.fs.doc.pipelines.importer.stages.FolderPathsExtractorStage

executeStage(ImporterPipelineContext) - Method in class com.norconex.crawler.web.doc.pipelines.importer.stages.CanonicalStage

executeStage(ImporterPipelineContext) - Method in class com.norconex.crawler.web.doc.pipelines.importer.stages.DelayResolverStage

executeStage(ImporterPipelineContext) - Method in class com.norconex.crawler.web.doc.pipelines.importer.stages.HttpFetchStage

Only does something if appropriate.

executeStage(ImporterPipelineContext) - Method in class com.norconex.crawler.web.doc.pipelines.importer.stages.LinkExtractorStage

executeStage(ImporterPipelineContext) - Method in class com.norconex.crawler.web.doc.pipelines.importer.stages.RecrawlableResolverStage

executeStage(ImporterPipelineContext) - Method in class com.norconex.crawler.web.doc.pipelines.importer.stages.RobotsMetaCreateStage

executeStage(ImporterPipelineContext) - Method in class com.norconex.crawler.web.doc.pipelines.importer.stages.RobotsMetaNoIndexStage

executeWithLock(String, Runnable) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.LockMapExecutor

executeWithLock(String, Callable<T>) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.LockMapExecutor

executeWithLockOrSkip(String, Runnable) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.LockMapExecutor

exists(String) - Method in class com.norconex.crawler.core.ledger.CrawlerEntryLedger

Whether a reference exists in the current ledger.

EXPIRED - Enum constant in enum class com.norconex.crawler.core.cluster.pipeline.PipelineStatus

Typically set by the coordinator on when a worker fails to give signs of life.

exportCaches(Consumer<SerializedCache>) - Method in interface com.norconex.crawler.core.cluster.CacheManager

Consumes every caches, where record value are serialized JSON String.

exportCaches(Consumer<SerializedCache>) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastCacheManager

exportCaches(Consumer<SerializedCache>) - Method in class com.norconex.crawler.core.cluster.impl.memory.MemoryCacheManager

exportCaches(Consumer<SerializedCache>) - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheManager

ExtensibleAnnotationFinder - Class in com.norconex.crawler.core.util

ExtensionReferenceFilter - Class in com.norconex.crawler.core.doc.operations.filter.impl

Filters a reference based on a comma-separated list of extensions.

ExtensionReferenceFilter() - Constructor for class com.norconex.crawler.core.doc.operations.filter.impl.ExtensionReferenceFilter

ExtensionReferenceFilterConfig - Class in com.norconex.crawler.core.doc.operations.filter.impl

Filters a reference based on a comma-separated list of extensions.

ExtensionReferenceFilterConfig() - Constructor for class com.norconex.crawler.core.doc.operations.filter.impl.ExtensionReferenceFilterConfig

ExternalParser - Class in com.norconex.importer.handler.parser.impl

ExternalParser() - Constructor for class com.norconex.importer.handler.parser.impl.ExternalParser

ExternalTransformer - Class in com.norconex.importer.handler.transformer.impl

ExternalTransformer() - Constructor for class com.norconex.importer.handler.transformer.impl.ExternalTransformer

ExternalTransformerConfig - Class in com.norconex.importer.handler.transformer.impl

ExternalTransformerConfig() - Constructor for class com.norconex.importer.handler.transformer.impl.ExternalTransformerConfig

EXTRACTED_ROBOTS_META - Static variable in class com.norconex.crawler.web.event.WebCrawlerEvent

ExtractionPattern() - Constructor for class com.norconex.crawler.web.doc.operations.link.impl.RegexLinkExtractorConfig.ExtractionPattern

ExtractionPattern(String, String) - Constructor for class com.norconex.crawler.web.doc.operations.link.impl.RegexLinkExtractorConfig.ExtractionPattern

extractLinks(Doc) - Method in class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractor

extractLinks(Doc) - Method in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractor

extractLinks(Doc) - Method in class com.norconex.crawler.web.doc.operations.link.impl.RegexLinkExtractor

extractLinks(Doc) - Method in class com.norconex.crawler.web.doc.operations.link.impl.TikaLinkExtractor

extractLinks(Doc) - Method in class com.norconex.crawler.web.doc.operations.link.impl.XmlFeedLinkExtractor

extractLinks(Doc) - Method in interface com.norconex.crawler.web.doc.operations.link.LinkExtractor

Extract links in certain parts only - Search tag in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractor

Section

extractSourceIdValue(CommitterRequest, String) - Static method in class com.norconex.committer.core.CommitterUtil

Extracts the source ID value.

extractSourceIdValue(CommitterRequest, String, boolean) - Static method in class com.norconex.committer.core.CommitterUtil

Extracts the source ID value.

F

FAILED - Enum constant in enum class com.norconex.crawler.core.cluster.pipeline.PipelineStatus

FAILED - Enum constant in enum class com.norconex.crawler.core.session.CrawlerState

fallbackCharset() - Method in class com.norconex.importer.charset.CharsetDetector.CharsetDetectorBuilder

fallbackCharset(String) - Method in class com.norconex.importer.charset.CharsetDetector.CharsetDetectorBuilder

fallbackCharset(Charset) - Method in class com.norconex.importer.charset.CharsetDetector.CharsetDetectorBuilder

FEATURED_IMAGE_INLINE_FIELD - Static variable in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig

FEATURED_IMAGE_PATH_FIELD - Static variable in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig

FEATURED_IMAGE_URL_FIELD - Static variable in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig

FeaturedImage - Class in com.norconex.crawler.web.doc.operations.image.impl

FeaturedImage(String, Dimension, BufferedImage) - Constructor for class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImage

FeaturedImageResolver - Class in com.norconex.crawler.web.doc.operations.image.impl

Document processor that extract the "main" image from HTML pages.

FeaturedImageResolver() - Constructor for class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolver

FeaturedImageResolverConfig - Class in com.norconex.crawler.web.doc.operations.image.impl

Configuration for FeaturedImageResolver.

FeaturedImageResolverConfig() - Constructor for class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig

FeaturedImageResolverConfig.Quality - Enum Class in com.norconex.crawler.web.doc.operations.image.impl

FeaturedImageResolverConfig.Storage - Enum Class in com.norconex.crawler.web.doc.operations.image.impl

Type of featured image storages.

FeaturedImageResolverConfig.StorageDiskStructure - Enum Class in com.norconex.crawler.web.doc.operations.image.impl

Directory structure when storing images on disk.

fetch(FetchRequest) - Method in interface com.norconex.crawler.core.fetch.Fetcher

fetch(FetchRequest) - Method in class com.norconex.crawler.core.fetch.MultiFetcher

Fetches a document.

fetch(FetchRequest) - Method in class com.norconex.crawler.fs.fetch.impl.AbstractNioFetcher

fetch(FetchRequest) - Method in class com.norconex.crawler.fs.fetch.impl.box.BoxFetcher

fetch(FetchRequest) - Method in class com.norconex.crawler.fs.fetch.impl.egnyte.EgnyteFetcher

fetch(FetchRequest) - Method in class com.norconex.crawler.fs.fetch.impl.googledrive.GoogleDriveFetcher

fetch(FetchRequest) - Method in class com.norconex.crawler.fs.fetch.impl.m365graph.M365GraphFetcher

fetch(FetchRequest) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcher

fetch(FetchRequest) - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcher

fetch(FetchRequest) - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcher

fetchChildPaths(FolderPathsFetchRequest) - Method in class com.norconex.crawler.fs.fetch.impl.AbstractNioFetcher

fetchChildPaths(FolderPathsFetchRequest) - Method in class com.norconex.crawler.fs.fetch.impl.archive.ArchiveFetcher

fetchContent(Doc, Path) - Method in class com.norconex.crawler.fs.fetch.impl.AbstractNioFetcher

FetchDirective - Enum Class in com.norconex.crawler.core.fetch

Whether to perform metadata extraction on its own before (or instead) performing document extraction as a whole (including metadata).

FetchDirectiveSupport - Enum Class in com.norconex.crawler.core.fetch

Indicates whether a given fetch directive should be required to execute, optional, or disabled.

fetchDriver() - Method in class com.norconex.crawler.core.CrawlerDriver

Provides a required fetcher implementation, responsible for obtaining resources being crawled.

fetchDriver(CrawlerDriver.FetchDriver) - Method in class com.norconex.crawler.core.CrawlerDriver.Builder

Provides a required fetcher implementation, responsible for obtaining resources being crawled.

FetchDriver() - Constructor for class com.norconex.crawler.core.CrawlerDriver.FetchDriver

FETCHED_ROBOTS_TXT - Static variable in class com.norconex.crawler.web.event.WebCrawlerEvent

fetcher(Fetcher) - Method in class com.norconex.crawler.core.context.CrawlerContext.Builder

fetcher(Fetcher) - Method in class com.norconex.crawler.web.doc.operations.sitemap.SitemapContext.SitemapContextBuilder

Fetcher - Interface in com.norconex.crawler.core.fetch

Fetch resources.

FETCHER - Static variable in class com.norconex.crawler.core.doc.CrawlerDocMetaConstants

Qualified name of fetcher used to fetch a document.

fetchers - Static variable in class com.norconex.crawler.core.CrawlerConfig.Fields

fetchers(List<? extends Fetcher>) - Method in class com.norconex.crawler.core.fetch.MultiFetcher.Builder

fetcherShutdown(CrawlerSession) - Method in class com.norconex.crawler.core.fetch.AbstractFetcher

Invoked once per fetcher when the crawler ends.

fetcherShutdown(CrawlerSession) - Method in class com.norconex.crawler.fs.fetch.impl.AbstractNioFetcher

fetcherShutdown(CrawlerSession) - Method in class com.norconex.crawler.fs.fetch.impl.adlsgen2.AdlsGen2Fetcher

fetcherShutdown(CrawlerSession) - Method in class com.norconex.crawler.fs.fetch.impl.archive.ArchiveFetcher

fetcherShutdown(CrawlerSession) - Method in class com.norconex.crawler.fs.fetch.impl.azureblob.AzureBlobFetcher

fetcherShutdown(CrawlerSession) - Method in class com.norconex.crawler.fs.fetch.impl.cmis.CmisFetcher

fetcherShutdown(CrawlerSession) - Method in class com.norconex.crawler.fs.fetch.impl.egnyte.EgnyteFetcher

fetcherShutdown(CrawlerSession) - Method in class com.norconex.crawler.fs.fetch.impl.gcs.GcsFetcher

fetcherShutdown(CrawlerSession) - Method in class com.norconex.crawler.fs.fetch.impl.googledrive.GoogleDriveFetcher

fetcherShutdown(CrawlerSession) - Method in class com.norconex.crawler.fs.fetch.impl.hdfs.HdfsFetcher

fetcherShutdown(CrawlerSession) - Method in class com.norconex.crawler.fs.fetch.impl.m365graph.M365GraphFetcher

fetcherShutdown(CrawlerSession) - Method in class com.norconex.crawler.fs.fetch.impl.s3.S3Fetcher

fetcherShutdown(CrawlerSession) - Method in class com.norconex.crawler.fs.fetch.impl.smb.SmbFetcher

fetcherShutdown(CrawlerSession) - Method in class com.norconex.crawler.fs.fetch.impl.webdav.WebDavFetcher

fetcherShutdown(CrawlerSession) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcher

fetcherShutdown(CrawlerSession) - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcher

fetcherShutdown(CrawlerSession) - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcher

fetchersMaxRetries - Static variable in class com.norconex.crawler.core.CrawlerConfig.Fields

fetchersRetryDelay - Static variable in class com.norconex.crawler.core.CrawlerConfig.Fields

fetcherStartup(CrawlerSession) - Method in class com.norconex.crawler.core.fetch.AbstractFetcher

Invoked once per fetcher instance, when the crawler starts.

fetcherStartup(CrawlerSession) - Method in class com.norconex.crawler.fs.fetch.impl.archive.ArchiveFetcher

fetcherStartup(CrawlerSession) - Method in class com.norconex.crawler.fs.fetch.impl.egnyte.EgnyteFetcher

fetcherStartup(CrawlerSession) - Method in class com.norconex.crawler.fs.fetch.impl.ftp.FtpFetcher

fetcherStartup(CrawlerSession) - Method in class com.norconex.crawler.fs.fetch.impl.googledrive.GoogleDriveFetcher

fetcherStartup(CrawlerSession) - Method in class com.norconex.crawler.fs.fetch.impl.hdfs.HdfsFetcher

fetcherStartup(CrawlerSession) - Method in class com.norconex.crawler.fs.fetch.impl.m365graph.M365GraphFetcher

fetcherStartup(CrawlerSession) - Method in class com.norconex.crawler.fs.fetch.impl.sftp.SftpFetcher

fetcherStartup(CrawlerSession) - Method in class com.norconex.crawler.fs.fetch.impl.smb.SmbFetcher

fetcherStartup(CrawlerSession) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcher

fetcherStartup(CrawlerSession) - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcher

fetcherStartup(CrawlerSession) - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcher

FetcherSupport - Class in com.norconex.crawler.fs.fetch.impl

Small shared helpers used by multiple fetcher implementations.

FetchException - Exception Class in com.norconex.crawler.core.fetch

Checked exception thrown upon encountering an error fetching a document.

FetchException() - Constructor for exception class com.norconex.crawler.core.fetch.FetchException

FetchException(String) - Constructor for exception class com.norconex.crawler.core.fetch.FetchException

FetchException(String, Throwable) - Constructor for exception class com.norconex.crawler.core.fetch.FetchException

FetchException(Throwable) - Constructor for exception class com.norconex.crawler.core.fetch.FetchException

fetchFileObject(FileFetchRequest) - Method in class com.norconex.crawler.fs.fetch.impl.AbstractNioFetcher

fetchMetadata(Doc, Path, BasicFileAttributes) - Method in class com.norconex.crawler.fs.fetch.impl.AbstractNioFetcher

fetchMetadata(Doc, Path, BasicFileAttributes) - Method in class com.norconex.crawler.fs.fetch.impl.cmis.CmisFetcher

fetchMetadata(Doc, Path, BasicFileAttributes) - Method in class com.norconex.crawler.fs.fetch.impl.local.LocalFetcher

fetchMetadata(Doc, Path, BasicFileAttributes) - Method in class com.norconex.crawler.fs.fetch.impl.smb.SmbFetcher

fetchMetadata(Doc, Path, BasicFileAttributes) - Method in class com.norconex.crawler.fs.fetch.impl.adlsgen2.AdlsGen2Fetcher

FetchRequest - Interface in com.norconex.crawler.core.fetch

Fetch request.

FetchResponse - Interface in com.norconex.crawler.core.fetch

FetchUtil - Class in com.norconex.crawler.core.fetch

Utility methods for fetching.

field - Static variable in class com.norconex.committer.core.fs.impl.CsvColumn.Fields

FIELD_PATTERN - Static variable in class com.norconex.committer.amazoncloudsearch.AmazonCloudSearchCommitter

CouldSearch mandatory field pattern.

Field creation - Search tag in class com.norconex.committer.sql.SqlCommitter

Section

Field mappings - Search tag in class com.norconex.committer.core.AbstractCommitter

Section

Field mappings - Search tag in class com.norconex.committer.core.BaseCommitterConfig

Section

fieldMatcher(TextMatcher) - Method in class com.norconex.importer.util.chunk.ChunkedTextReader.ChunkedTextReaderBuilder

Field names and errors - Search tag in class com.norconex.committer.azurecognitivesearch.AzureSearchCommitter

Section

Field naming rules - Search tag in class com.norconex.committer.azurecognitivesearch.AzureSearchCommitter

Section

FieldReportTransformer - Class in com.norconex.importer.handler.transformer.impl

A utility tagger that reports in a CSV file the fields discovered in a crawl session, captured at the point of your choice in the importing process.

FieldReportTransformer() - Constructor for class com.norconex.importer.handler.transformer.impl.FieldReportTransformer

FieldReportTransformerConfig - Class in com.norconex.importer.handler.transformer.impl

A utility tagger that reports in a CSV file the fields discovered in a crawl session, captured at the point of your choice in the importing process.

FieldReportTransformerConfig() - Constructor for class com.norconex.importer.handler.transformer.impl.FieldReportTransformerConfig

Fields() - Constructor for class com.norconex.committer.core.fs.impl.CsvColumn.Fields

Fields() - Constructor for class com.norconex.committer.core.fs.impl.CsvFileCommitter.Fields

Fields() - Constructor for class com.norconex.committer.core.fs.impl.CsvFileCommitterConfig.Fields

Fields() - Constructor for class com.norconex.committer.core.fs.impl.JsonFileCommitterConfig.Fields

Fields() - Constructor for class com.norconex.committer.core.fs.impl.XmlFileCommitterConfig.Fields

Fields() - Constructor for class com.norconex.crawler.core.CrawlerConfig.Fields

Fields() - Constructor for class com.norconex.crawler.core.ledger.CrawlerEntry.Fields

Fields() - Constructor for class com.norconex.crawler.web.doc.operations.delay.impl.DelayRange.Fields

Fields() - Constructor for class com.norconex.crawler.web.doc.operations.sitemap.impl.GenericSitemapLocatorConfig.Fields

Fields() - Constructor for class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthConfig.Fields

Fields() - Constructor for class com.norconex.crawler.web.WebCrawlerConfig.Fields

Fields() - Constructor for class com.norconex.importer.handler.condition.impl.BlankCondition.Fields

Fields() - Constructor for class com.norconex.importer.handler.condition.impl.DateCondition.Fields

Fields() - Constructor for class com.norconex.importer.handler.condition.impl.NumericCondition.Fields

Fields() - Constructor for class com.norconex.importer.handler.parser.impl.OcrConfig.Fields

Fields() - Constructor for class com.norconex.importer.handler.transformer.impl.DateFormatTransformerConfig.Fields

file(boolean) - Method in class com.norconex.crawler.fs.fetch.impl.GenericFileFetchResponse.GenericFileFetchResponseBuilder

FILE_SIZE - Static variable in class com.norconex.crawler.fs.doc.FsDocMetadata

FileFetchRequest - Class in com.norconex.crawler.fs.fetch

FileFetchRequest(Doc, FetchDirective) - Constructor for class com.norconex.crawler.fs.fetch.FileFetchRequest

FileFetchResponse - Interface in com.norconex.crawler.fs.fetch

FileFetchStage - Class in com.norconex.crawler.fs.doc.pipelines.importer.stages

Fetches (i.e. download/copy for processing) a document and/or its metadata (e.g., file properties) depending on supplied FetchDirective.

FileFetchStage(FetchDirective) - Constructor for class com.norconex.crawler.fs.doc.pipelines.importer.stages.FileFetchStage

FileFetchUtil - Class in com.norconex.crawler.fs.fetch.impl

fileKey() - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyFileAttributes

File naming - Search tag in class com.norconex.crawler.web.event.listeners.UrlStatusCrawlerEventListener

Section

fileSystemLabel() - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyFileSystemProvider

filter - Static variable in class com.norconex.importer.handler.parser.impl.OcrConfig.Fields

filter(RobotsTxtFilter) - Method in class com.norconex.crawler.web.doc.operations.robot.RobotsTxt.RobotsTxtBuilder

Filter by status codes - Search tag in class com.norconex.crawler.web.event.listeners.UrlStatusCrawlerEventListener

Section

FilterGroupResolver<T> - Class in com.norconex.crawler.core.doc.operations.filter

Resolves a group of filters, marking the group as accepted (true) if All following conditions are met: All filters NOT implementing OnMatchFilter return true.

FilterGroupResolver.FilterGroupResolverBuilder<T> - Class in com.norconex.crawler.core.doc.operations.filter

Filtering Unwanted Documents - Search tag in class com.norconex.crawler.web.WebCrawlerConfig

Section

filterResolver(Predicate<T>) - Method in class com.norconex.crawler.core.doc.operations.filter.FilterGroupResolver.FilterGroupResolverBuilder

filters(Collection<? extends RobotsTxtFilter>) - Method in class com.norconex.crawler.web.doc.operations.robot.RobotsTxt.RobotsTxtBuilder

filters(List<F>) - Method in class com.norconex.crawler.core.doc.pipelines.OnMatchFiltersResolver.OnMatchFiltersResolverBuilder

find(AnnotatedElement, Class<A>) - Static method in class com.norconex.crawler.core.util.ExtensibleAnnotationFinder

Finding the image - Search tag in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolver

Section

findOrTrackDocument(CrawlerEntry) - Method in class com.norconex.crawler.core.doc.pipelines.DedupService

Finds a document with the same checksum as the one supplied (effectively being a duplicate) and return its reference.

findOrTrackMetadata(CrawlerEntry) - Method in class com.norconex.crawler.core.doc.pipelines.DedupService

Finds a document with the same checksum as the one supplied (effectively being a duplicate) and return its reference.

findZipFiles(Path) - Static method in class com.norconex.committer.core.batch.queue.impl.FSQueueUtil

Finds all files with the ".zip" extension from within a given directory, recursively.

finishedAt(long) - Method in class com.norconex.crawler.core.cluster.pipeline.PipelineResult.PipelineResultBuilder

fire(Event) - Method in class com.norconex.crawler.core.session.CrawlerEventBus

Fires the given event through the underlying event manager.

fire(Event) - Method in class com.norconex.crawler.core.session.CrawlerSession

Shortcut method for firing an event equivalent to: session.getCrawlContext().getEventManager().fire(event).

fire(String, Object) - Method in class com.norconex.crawler.core.session.CrawlerSession

Shortcut method for firing a CrawlerEvent with the supplied source and with the crawlSession field already set.

fireDebug(String) - Method in class com.norconex.committer.core.AbstractCommitter

fireDebug(String, CommitterRequest) - Method in class com.norconex.committer.core.AbstractCommitter

fireError(String, CommitterRequest, Exception) - Method in class com.norconex.committer.core.AbstractCommitter

fireError(String, Exception) - Method in class com.norconex.committer.core.AbstractCommitter

FIREFOX - Enum constant in enum class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightBrowser

Mozilla Firefox.

FIREFOX - Enum constant in enum class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverBrowser

fireIfUrlOutOfScope(CrawlerSession, WebCrawlerEntry, UrlScope) - Static method in class com.norconex.crawler.web.util.Web

fireInfo(String) - Method in class com.norconex.committer.core.AbstractCommitter

fireInfo(String, CommitterRequest) - Method in class com.norconex.committer.core.AbstractCommitter

FIRST - Enum constant in enum class com.norconex.crawler.web.doc.operations.recrawl.impl.GenericRecrawlableResolverConfig.SitemapSupport

firstNonBlank(String...) - Static method in class com.norconex.crawler.fs.fetch.impl.FetcherSupport

firstNonBlankOrUTF8(ParseState, String...) - Static method in class com.norconex.importer.charset.CharsetUtil

Returns the first non-blank character encoding, or returns UTF-8 if they are all blank or in post-parse state.

firstNonBlankOrUTF8(String...) - Static method in class com.norconex.importer.charset.CharsetUtil

Returns the first non-blank character encoding, or returns UTF-8 if they are all blank.

firstNonNullOrUTF8(ParseState, Charset...) - Static method in class com.norconex.importer.charset.CharsetUtil

Returns the first non-blank character encoding, or returns UTF-8 if they are all blank or in post-parse state.

firstNonNullOrUTF8(Charset...) - Static method in class com.norconex.importer.charset.CharsetUtil

Returns the first non-blank character encoding, or returns UTF-8 if they are all blank.

fits(int, int) - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImage

fits(FeaturedImage) - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImage

fits(Dimension) - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImage

flush() - Method in interface com.norconex.crawler.core.metrics.CrawlerMetrics

Flushes the metrics.

flush() - Method in class com.norconex.crawler.core.metrics.CrawlerMetricsImpl

flush() - Method in class com.norconex.importer.handler.DocHandlerContext

Flush and dispose any output that has been written to with DocHandlerContext.output() and apply it as the input source of the underlying document.

flushBuffer(StringBuilder, Writer, boolean) - Static method in class com.norconex.importer.util.BufferUtil

Flushes the buffer to output stream.

folder(boolean) - Method in class com.norconex.crawler.fs.fetch.impl.GenericFileFetchResponse.GenericFileFetchResponseBuilder

FOLDER - Enum constant in enum class com.norconex.crawler.fs.fetch.impl.FolderItemReferenceParser.Kind

folderId() - Method in record class com.norconex.crawler.fs.fetch.impl.FolderItemReferenceParser.Parsed

Returns the value of the folderId record component.

FolderItemReferenceParser - Class in com.norconex.crawler.fs.fetch.impl

FolderItemReferenceParser.Kind - Enum Class in com.norconex.crawler.fs.fetch.impl

FolderItemReferenceParser.Parsed - Record Class in com.norconex.crawler.fs.fetch.impl

FolderPathsExtractorStage - Class in com.norconex.crawler.fs.doc.pipelines.importer.stages

FolderPathsExtractorStage(FetchDirective) - Constructor for class com.norconex.crawler.fs.doc.pipelines.importer.stages.FolderPathsExtractorStage

FolderPathsFetchRequest - Class in com.norconex.crawler.fs.fetch

A request to get all direct paths within a folder.

FolderPathsFetchRequest(Doc) - Constructor for class com.norconex.crawler.fs.fetch.FolderPathsFetchRequest

FolderPathsFetchResponse - Interface in com.norconex.crawler.fs.fetch

ForceSingleValueTransformer - Class in com.norconex.importer.handler.transformer.impl

Forces a metadata field to be single-value.

ForceSingleValueTransformer() - Constructor for class com.norconex.importer.handler.transformer.impl.ForceSingleValueTransformer

ForceSingleValueTransformerConfig - Class in com.norconex.importer.handler.transformer.impl

Forces a metadata field to be single-value.

ForceSingleValueTransformerConfig() - Constructor for class com.norconex.importer.handler.transformer.impl.ForceSingleValueTransformerConfig

forEach(BiConsumer<String, ? super T>) - Method in interface com.norconex.crawler.core.cluster.CacheMap

forEach(BiConsumer<String, ? super T>) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastMapAdapter

forEach(BiConsumer<String, ? super T>) - Method in class com.norconex.crawler.core.cluster.impl.memory.InMemoryCacheMap

forEach(BiConsumer<String, ? super T>) - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheMap

forEach(Consumer<String>) - Method in interface com.norconex.crawler.core.cluster.CacheSet

forEach(Consumer<String>) - Method in class com.norconex.crawler.core.cluster.impl.memory.InMemoryCacheSet

forEach(Consumer<String>) - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheSet

forEachBaseline(Consumer<CrawlerEntry>) - Method in class com.norconex.crawler.core.ledger.CrawlerEntryLedger

forEachProcessed(Consumer<CrawlerEntry>) - Method in class com.norconex.crawler.core.ledger.CrawlerEntryLedger

forEachProcessing(Consumer<CrawlerEntry>) - Method in class com.norconex.crawler.core.ledger.CrawlerEntryLedger

forEachQueued(Consumer<CrawlerEntry>) - Method in class com.norconex.crawler.core.ledger.CrawlerEntryLedger

FORM - Enum constant in enum class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthMethod

Form-based authentication method.

format - Static variable in class com.norconex.committer.core.fs.impl.CsvFileCommitterConfig.Fields

formCharset - Static variable in class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthConfig.Fields

formParams - Static variable in class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthConfig.Fields

formPasswordField - Static variable in class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthConfig.Fields

formSelector - Static variable in class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthConfig.Fields

formUsernameField - Static variable in class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthConfig.Fields

FRI - Enum constant in enum class com.norconex.crawler.web.doc.operations.delay.impl.DelaySchedule.DOW

from(ChunkedTextSupport) - Static method in class com.norconex.importer.util.chunk.ChunkedTextReader

fromField - Static variable in class com.norconex.importer.handler.transformer.impl.DateFormatTransformerConfig.Fields

fromFormats - Static variable in class com.norconex.importer.handler.transformer.impl.DateFormatTransformerConfig.Fields

fromJson(Reader, Class<T>) - Static method in class com.norconex.crawler.core.util.SerialUtil

fromJson(String, Class<T>) - Static method in class com.norconex.crawler.core.util.SerialUtil

fromJson(JsonParser, Class<T>) - Static method in class com.norconex.crawler.core.util.SerialUtil

fromJson(JsonNode, Class<T>) - Static method in class com.norconex.crawler.core.util.SerialUtil

fromLocale - Static variable in class com.norconex.importer.handler.transformer.impl.DateFormatTransformerConfig.Fields

fromValue(String) - Static method in enum class com.norconex.committer.googlecloudsearch.MetadataField

fromZipFile(Path) - Static method in class com.norconex.committer.core.batch.queue.impl.FSQueueUtil

fromZipFile(Path, CachedStreamFactory) - Static method in class com.norconex.committer.core.batch.queue.impl.FSQueueUtil

FsCrawler - Class in com.norconex.crawler.fs

FsCrawlerDocContext - Class in com.norconex.crawler.fs.doc

Deprecated, for removal: This API element is subject to removal in a future version.

Use FsCrawlerEntry instead.

FsCrawlerDocContext() - Constructor for class com.norconex.crawler.fs.doc.FsCrawlerDocContext

Deprecated.

FsCrawlerDocContext(String) - Constructor for class com.norconex.crawler.fs.doc.FsCrawlerDocContext

Deprecated.

FsCrawlerDocContext(String, int) - Constructor for class com.norconex.crawler.fs.doc.FsCrawlerDocContext

Deprecated.

FsCrawlerDriverFactory - Class in com.norconex.crawler.fs

FsCrawlerDriverFactory() - Constructor for class com.norconex.crawler.fs.FsCrawlerDriverFactory

FsCrawlerEntry - Class in com.norconex.crawler.fs.ledger

A path being crawled holding relevant crawl state information.

FsCrawlerEntry() - Constructor for class com.norconex.crawler.fs.ledger.FsCrawlerEntry

FsCrawlerEntry(String) - Constructor for class com.norconex.crawler.fs.ledger.FsCrawlerEntry

FsCrawlerEntry(String, int) - Constructor for class com.norconex.crawler.fs.ledger.FsCrawlerEntry

FsDocMetadata - Class in com.norconex.crawler.fs.doc

FsMetadataChecksummer - Class in com.norconex.crawler.fs.doc.operations.checksum

Default implementation of MetadataChecksummer which by default returns the combined values of FsDocMetadata.LAST_MODIFIED and FsDocMetadata.FILE_SIZE, separated with an underscore (e.g. "14125443181234_123").

FsMetadataChecksummer() - Constructor for class com.norconex.crawler.fs.doc.operations.checksum.FsMetadataChecksummer

FsPath - Class in com.norconex.crawler.fs.fetch

FsPath(String) - Constructor for class com.norconex.crawler.fs.fetch.FsPath

FsPipelines - Class in com.norconex.crawler.fs.doc.pipelines

FsQueue - Class in com.norconex.committer.core.batch.queue.impl

File System queue.

FsQueue() - Constructor for class com.norconex.committer.core.batch.queue.impl.FsQueue

FsQueue.SplitBatch - Enum Class in com.norconex.committer.core.batch.queue.impl

FsQueueConfig - Class in com.norconex.committer.core.batch.queue.impl

FsQueueConfig() - Constructor for class com.norconex.committer.core.batch.queue.impl.FsQueueConfig

FsQueueConfig.OnCommitFailure - Class in com.norconex.committer.core.batch.queue.impl

FSQueueUtil - Class in com.norconex.committer.core.batch.queue.impl

File sytem queue utility methods.

FtpFetcher - Class in com.norconex.crawler.fs.fetch.impl.ftp

FTP (ftp://) and FTPS (ftps://) fetcher, backed by the ftp-fs NIO.2 file system provider.

FtpFetcher() - Constructor for class com.norconex.crawler.fs.fetch.impl.ftp.FtpFetcher

FtpFetcherConfig - Class in com.norconex.crawler.fs.fetch.impl.ftp

Configuration for FtpFetcher.

FtpFetcherConfig() - Constructor for class com.norconex.crawler.fs.fetch.impl.ftp.FtpFetcherConfig

FULL - Enum constant in enum class com.norconex.crawler.core.session.CrawlerMode

Disregard any previous crawl and crawl as if it was the first time.

G

GcsFetcher - Class in com.norconex.crawler.fs.fetch.impl.gcs

Fetcher for Google Cloud Storage (gs://bucket/object), backed by the official Google-maintained google-cloud-nio provider.

GcsFetcher() - Constructor for class com.norconex.crawler.fs.fetch.impl.gcs.GcsFetcher

GcsFetcherConfig - Class in com.norconex.crawler.fs.fetch.impl.gcs

Configuration for GcsFetcher.

GcsFetcherConfig() - Constructor for class com.norconex.crawler.fs.fetch.impl.gcs.GcsFetcherConfig

GENERATED_TITLE - Static variable in class com.norconex.importer.doc.DocMetaConstants

Generated title.

Generated JSON format: - Search tag in class com.norconex.committer.core.fs.impl.JsonFileCommitter

Section

Generated XML format: - Search tag in class com.norconex.committer.core.fs.impl.XmlFileCommitter

Section

GenericCanonicalLinkDetector - Class in com.norconex.crawler.web.doc.operations.canon.impl

Generic canonical link detector.

GenericCanonicalLinkDetector() - Constructor for class com.norconex.crawler.web.doc.operations.canon.impl.GenericCanonicalLinkDetector

GenericCanonicalLinkDetectorConfig - Class in com.norconex.crawler.web.doc.operations.canon.impl

Configuration for GenericCanonicalLinkDetector.

GenericCanonicalLinkDetectorConfig() - Constructor for class com.norconex.crawler.web.doc.operations.canon.impl.GenericCanonicalLinkDetectorConfig

GenericCanonicalLinkDetectorConfig(List<ContentType>) - Constructor for class com.norconex.crawler.web.doc.operations.canon.impl.GenericCanonicalLinkDetectorConfig

GenericDelayResolver - Class in com.norconex.crawler.web.doc.operations.delay.impl

Default implementation for creating voluntary delays between URL downloads.

GenericDelayResolver() - Constructor for class com.norconex.crawler.web.doc.operations.delay.impl.GenericDelayResolver

GenericDelayResolverConfig - Class in com.norconex.crawler.web.doc.operations.delay.impl

Configuration for GenericDelayResolver.

GenericDelayResolverConfig() - Constructor for class com.norconex.crawler.web.doc.operations.delay.impl.GenericDelayResolverConfig

GenericFileFetchResponse - Class in com.norconex.crawler.fs.fetch.impl

GenericFileFetchResponse.GenericFileFetchResponseBuilder - Class in com.norconex.crawler.fs.fetch.impl

GenericFolderPathsFetchResponse - Class in com.norconex.crawler.fs.fetch.impl

GenericFolderPathsFetchResponse.GenericFolderPathsFetchResponseBuilder - Class in com.norconex.crawler.fs.fetch.impl

GenericMetadataChecksummer - Class in com.norconex.crawler.core.doc.operations.checksum.impl

Generic implementation of MetadataChecksummer that uses specified field names and their values to create a checksum.

GenericMetadataChecksummer() - Constructor for class com.norconex.crawler.core.doc.operations.checksum.impl.GenericMetadataChecksummer

GenericMetadataChecksummerConfig - Class in com.norconex.crawler.core.doc.operations.checksum.impl

Configuration for GenericMetadataChecksummer.

GenericMetadataChecksummerConfig() - Constructor for class com.norconex.crawler.core.doc.operations.checksum.impl.GenericMetadataChecksummerConfig

GenericMetadataFilter - Class in com.norconex.crawler.core.doc.operations.filter.impl

Accepts or rejects a reference based on whether one or more metadata field values are matching.

GenericMetadataFilter() - Constructor for class com.norconex.crawler.core.doc.operations.filter.impl.GenericMetadataFilter

GenericMetadataFilterConfig - Class in com.norconex.crawler.core.doc.operations.filter.impl

Accepts or rejects a reference based on whether one or more metadata field values are matching.

GenericMetadataFilterConfig() - Constructor for class com.norconex.crawler.core.doc.operations.filter.impl.GenericMetadataFilterConfig

GenericRecrawlableResolver - Class in com.norconex.crawler.web.doc.operations.recrawl.impl

Relies on both sitemap directives and custom instructions for establishing the minimum frequency between each document recrawl.

GenericRecrawlableResolver() - Constructor for class com.norconex.crawler.web.doc.operations.recrawl.impl.GenericRecrawlableResolver

GenericRecrawlableResolverConfig - Class in com.norconex.crawler.web.doc.operations.recrawl.impl

Configuration for GenericRecrawlableResolver.

GenericRecrawlableResolverConfig() - Constructor for class com.norconex.crawler.web.doc.operations.recrawl.impl.GenericRecrawlableResolverConfig

GenericRecrawlableResolverConfig.MinFrequency - Class in com.norconex.crawler.web.doc.operations.recrawl.impl

GenericRecrawlableResolverConfig.MinFrequency.ApplyTo - Enum Class in com.norconex.crawler.web.doc.operations.recrawl.impl

GenericRecrawlableResolverConfig.SitemapSupport - Enum Class in com.norconex.crawler.web.doc.operations.recrawl.impl

GenericRedirectUrlProvider - Class in com.norconex.crawler.web.fetch.util

Provide redirect URLs by grabbing them from the HTTP Response Location header value.

GenericRedirectUrlProvider() - Constructor for class com.norconex.crawler.web.fetch.util.GenericRedirectUrlProvider

GenericRedirectUrlProviderConfig - Class in com.norconex.crawler.web.fetch.util

Configuration for GenericRedirectUrlProvider.

GenericRedirectUrlProviderConfig() - Constructor for class com.norconex.crawler.web.fetch.util.GenericRedirectUrlProviderConfig

GenericReferenceFilter - Class in com.norconex.crawler.core.doc.operations.filter.impl

Filters URL based on a matching expression.

GenericReferenceFilter() - Constructor for class com.norconex.crawler.core.doc.operations.filter.impl.GenericReferenceFilter

GenericReferenceFilterConfig - Class in com.norconex.crawler.core.doc.operations.filter.impl

Filters URL based on a matching expression.

GenericReferenceFilterConfig() - Constructor for class com.norconex.crawler.core.doc.operations.filter.impl.GenericReferenceFilterConfig

GenericSitemapLocator - Class in com.norconex.crawler.web.doc.operations.sitemap.impl

If there is a sitemap defined as a start reference for the same URL web site, this locator is not used.

GenericSitemapLocator() - Constructor for class com.norconex.crawler.web.doc.operations.sitemap.impl.GenericSitemapLocator

GenericSitemapLocatorConfig - Class in com.norconex.crawler.web.doc.operations.sitemap.impl

Configuration for GenericSitemapLocator.

GenericSitemapLocatorConfig() - Constructor for class com.norconex.crawler.web.doc.operations.sitemap.impl.GenericSitemapLocatorConfig

GenericSitemapLocatorConfig.Fields - Class in com.norconex.crawler.web.doc.operations.sitemap.impl

GenericSitemapResolver - Class in com.norconex.crawler.web.doc.operations.sitemap.impl

GenericSitemapResolver() - Constructor for class com.norconex.crawler.web.doc.operations.sitemap.impl.GenericSitemapResolver

GenericSitemapResolverConfig - Class in com.norconex.crawler.web.doc.operations.sitemap.impl

GenericSitemapResolverConfig() - Constructor for class com.norconex.crawler.web.doc.operations.sitemap.impl.GenericSitemapResolverConfig

GenericSpoiledReferenceStrategizer - Class in com.norconex.crawler.core.doc.operations.spoil.impl

Generic implementation of SpoiledReferenceStrategizer that offers a simple mapping between the crawl state of references that have turned "bad" and the strategy to adopt for each.

GenericSpoiledReferenceStrategizer() - Constructor for class com.norconex.crawler.core.doc.operations.spoil.impl.GenericSpoiledReferenceStrategizer

GenericSpoiledReferenceStrategizerConfig - Class in com.norconex.crawler.core.doc.operations.spoil.impl

Configuration for GenericSpoiledReferenceStrategizer.

GenericSpoiledReferenceStrategizerConfig() - Constructor for class com.norconex.crawler.core.doc.operations.spoil.impl.GenericSpoiledReferenceStrategizerConfig

GenericUrlNormalizer - Class in com.norconex.crawler.web.doc.operations.url.impl

Generic implementation of WebUrlNormalizer that should satisfy most URL normalization needs.

GenericUrlNormalizer() - Constructor for class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizer

GenericUrlNormalizerConfig - Class in com.norconex.crawler.web.doc.operations.url.impl

Configuration for GenericUrlNormalizer.

GenericUrlNormalizerConfig() - Constructor for class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizerConfig

GenericUrlNormalizerConfig.Normalization - Enum Class in com.norconex.crawler.web.doc.operations.url.impl

GenericUrlNormalizerConfig.NormalizationReplace - Class in com.norconex.crawler.web.doc.operations.url.impl

GenericUrlScopeResolver - Class in com.norconex.crawler.web.doc.operations.scope.impl

By default a crawler will try to follow all links it discovers.

GenericUrlScopeResolver() - Constructor for class com.norconex.crawler.web.doc.operations.scope.impl.GenericUrlScopeResolver

GenericUrlScopeResolverConfig - Class in com.norconex.crawler.web.doc.operations.scope.impl

Configuration for GenericUrlScopeResolver.

GenericUrlScopeResolverConfig() - Constructor for class com.norconex.crawler.web.doc.operations.scope.impl.GenericUrlScopeResolverConfig

get() - Method in interface com.norconex.crawler.core.cluster.Counter

get() - Method in class com.norconex.crawler.fs.FsCrawlerDriverFactory

get() - Static method in class com.norconex.crawler.web.callbacks.WebCrawlerCallbacks

get() - Method in class com.norconex.crawler.web.WebCrawlerDriverFactory

get() - Static method in class com.norconex.importer.Importer

get(String) - Method in interface com.norconex.crawler.core.cluster.CacheMap

get(String) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastMapAdapter

get(String) - Method in class com.norconex.crawler.core.cluster.impl.memory.InMemoryCacheMap

get(String) - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheMap

get(Future<T>) - Static method in class com.norconex.crawler.core.util.ConcurrentUtil

Calls Future.get() and wraps thread related exceptions in a runtime CompletionException.

get(Future<T>, long, TimeUnit) - Static method in class com.norconex.crawler.core.util.ConcurrentUtil

Calls Future.get(long, TimeUnit) and wraps thread related exceptions in a runtime CompletionException.

GET - Enum constant in enum class com.norconex.crawler.web.fetch.HttpMethod

getAcceptedIssuers() - Method in class com.norconex.crawler.web.fetch.util.TrustAllX509TrustManager

getAccessKey() - Method in class com.norconex.committer.amazoncloudsearch.AmazonCloudSearchCommitterConfig

The CloudSearch access key.

getAccessToken() - Method in class com.norconex.crawler.fs.fetch.impl.box.BoxFetcherConfig

OAuth access token used for Box API requests.

getAccessToken() - Method in class com.norconex.crawler.fs.fetch.impl.egnyte.EgnyteFetcherConfig

OAuth access token used for Egnyte API requests.

getAclInheritance() - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig

ACL inheritance configuration, mapping a metadata field holding a parent item reference to an ACL inheritance type.

getAclInheritanceType() - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.AclInheritanceMapping

ACL inheritance type.

getAclMappings() - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig

getAction() - Method in class com.norconex.importer.handler.transformer.impl.ForceSingleValueTransformerConfig

The action.

getAddCount() - Method in class com.norconex.committer.core.impl.LogCommitter

getAddress() - Method in class com.norconex.crawler.web.fetch.impl.webdriver.HttpSniffer

getAdminCache() - Method in interface com.norconex.crawler.core.cluster.CacheManager

Gets the admin cache for storing administrative data.

getAdminCache() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastCacheManager

getAdminCache() - Method in class com.norconex.crawler.core.cluster.impl.memory.MemoryCacheManager

getAdminCache() - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheManager

getAdminPort() - Method in class com.norconex.crawler.core.cluster.ClusterConfig

Port the crawler cluster listens to for administrative commands, on each nodes.

getAdminPort() - Method in class com.norconex.crawler.core.session.CrawlerSession

getAfterCommand() - Method in class com.norconex.crawler.core.CrawlerCallbacks

Invoked after a command has been executed, but before resources are closed.

getAfterDocumentFinalizing() - Method in class com.norconex.crawler.core.CrawlerCallbacks

getAfterDocumentProcessing() - Method in class com.norconex.crawler.core.CrawlerCallbacks

getAfterSession() - Method in class com.norconex.crawler.core.CrawlerCallbacks

Invoked after a crawl session has been destroyed and resources closed.

getAllowFilters() - Method in class com.norconex.crawler.web.doc.operations.robot.RobotsTxt

Gets "Allow" filters.

getAllRequests() - Method in class com.norconex.committer.core.impl.MemoryCommitter

getAndAdd(long) - Method in interface com.norconex.crawler.core.cluster.Counter

getAndDecrement() - Method in interface com.norconex.crawler.core.cluster.Counter

getAndIncrement() - Method in interface com.norconex.crawler.core.cluster.Counter

getApi() - Method in class com.norconex.importer.handler.splitter.impl.TranslatorSplitterConfig

Supported translation service API name.

getApiBaseUrl() - Method in class com.norconex.crawler.fs.fetch.impl.box.BoxFetcherConfig

Box API base URL.

getApiBaseUrl() - Method in class com.norconex.crawler.fs.fetch.impl.egnyte.EgnyteFetcherConfig

Egnyte API base URL.

getApiEndpoint() - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig

Overrides the Google Cloud Search API root URL.

getApiKey() - Method in class com.norconex.committer.azurecognitivesearch.AzureSearchCommitterConfig

The Azure API admin key.

getApiKey() - Method in class com.norconex.committer.elasticsearch.ElasticsearchCommitterConfig

The Base64-encoded API key for Elasticsearch API Key authentication.

getApiKey() - Method in class com.norconex.importer.handler.splitter.impl.TranslatorSplitterConfig

Google or Yandex API key.

getApiVersion() - Method in class com.norconex.committer.azurecognitivesearch.AzureSearchCommitterConfig

The Azure API version.

getApplicationName() - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig

The application name sent to Google Cloud Search.

getApplicationName() - Method in class com.norconex.crawler.fs.fetch.impl.googledrive.GoogleDriveFetcherConfig

Optional Google API application name.

getApplyRotation() - Method in class com.norconex.importer.handler.parser.impl.OcrConfig

getApplyTo() - Method in class com.norconex.crawler.web.doc.operations.recrawl.impl.GenericRecrawlableResolverConfig.MinFrequency

Whether to apply this minimum frequency to matching content type or document reference.

getApplyTo() - Method in class com.norconex.importer.handler.transformer.impl.CharacterCaseTransformerConfig

Whether to apply the case transformation to fields, values, or both.

getArea() - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImage

getArgs() - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcherConfig

Returns an unmodifiable view of the browser launch arguments.

getArguments() - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig

Optional command-line arguments supported by some web driver or browser.

getArrayFields() - Method in class com.norconex.committer.azurecognitivesearch.AzureSearchCommitterConfig

The fields which values should always be treated as array.

getAuthentication() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

Authentication configuration for sites requiring it.

getAuthMethod() - Method in class com.norconex.crawler.fs.fetch.impl.hdfs.HdfsFetcherConfig

Authentication method.

getAuthorityHost() - Method in class com.norconex.crawler.fs.fetch.impl.m365graph.M365GraphFetcherConfig

Authentication authority host.

getAutoCommitBufferSize() - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreClusterConnectorConfig

The auto-commit buffer size in KB.

getAutoCommitDelay() - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreClusterConnectorConfig

The auto-commit delay in milliseconds.

getAutoCompactFillRate() - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreClusterConnectorConfig

The auto-compact fill rate (0-100).

getBackupCount() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.JdbcHazelcastConfigurer

Hazelcast backup count.

getBaselineCount() - Method in class com.norconex.crawler.core.ledger.CrawlerEntryLedger

getBaselineCount() - Method in class com.norconex.crawler.core.metrics.CrawlerMetricsImpl

getBaselineCount() - Method in interface com.norconex.crawler.core.metrics.CrawlerMetricsMXBean

getBaselineEntry(String) - Method in class com.norconex.crawler.core.ledger.CrawlerEntryLedger

getBatchConsumer() - Method in class com.norconex.committer.core.batch.queue.impl.FsQueue

getBatchSize() - Method in class com.norconex.committer.core.batch.queue.impl.FsQueueConfig

The number of documents to be queued in a batch on disk before consuming that batch.

getBeanMapper() - Method in class com.norconex.crawler.core.context.CrawlerContext

getBeforeCommand() - Method in class com.norconex.crawler.core.CrawlerCallbacks

Invoked before a command is executed, after the session and crawl context have been initialized.

getBeforeDocumentFinalizing() - Method in class com.norconex.crawler.core.CrawlerCallbacks

getBeforeDocumentProcessing() - Method in class com.norconex.crawler.core.CrawlerCallbacks

getBeforeSession() - Method in class com.norconex.crawler.core.CrawlerCallbacks

Invoked before the crawl session gets initialized (which is also before any command gets executed).

getBegin() - Method in class com.norconex.importer.handler.transformer.impl.SubstringTransformerConfig

The beginning index (inclusive).

getBoolean(String) - Method in class com.norconex.crawler.core.session.CrawlerAttributes

Gets an attribute as a boolean.

getBootstrappers() - Method in class com.norconex.crawler.core.context.CrawlerContext

getBootstrapServers() - Method in class com.norconex.committer.apachekafka.ApacheKafkaCommitterConfig

The Apache Kafka broker list, comma-separated (e.g., host1:port1,host2:port2,...).

getBrowser() - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcherConfig

The browser engine used for crawling.

getBrowser() - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig

The browser used for crawling.

getBrowserMaxAge() - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcherConfig

Maximum age of a per-thread browser instance before it is restarted.

getBrowserMaxAge() - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig

A maximum duration at which we restart the browser.

getBrowserMaxNavigations() - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcherConfig

A maximum number of navigations after which each per-thread browser instance is restarted.

getBrowserMaxNavigations() - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig

A maximum number of navigations at which we restart the browser.

getBrowserPath() - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig

Local path to browser executable or null to attempt automatic browser path detection.

getCache() - Method in class com.norconex.crawler.core.session.CrawlerAttributes

The underlying cache.

getCacheManager() - Method in interface com.norconex.crawler.core.cluster.Cluster

getCacheManager() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastCluster

getCacheManager() - Method in class com.norconex.crawler.core.cluster.impl.memory.MemoryCluster

getCacheManager() - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCluster

getCacheMap(String, Class<T>) - Method in interface com.norconex.crawler.core.cluster.CacheManager

Gets a named cache storing objects of the supplied type.

getCacheMap(String, Class<T>) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastCacheManager

getCacheMap(String, Class<T>) - Method in class com.norconex.crawler.core.cluster.impl.memory.MemoryCacheManager

getCacheMap(String, Class<T>) - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheManager

getCacheName() - Method in class com.norconex.crawler.core.cluster.SerializedCache

getCacheQueue(String, Class<T>) - Method in interface com.norconex.crawler.core.cluster.CacheManager

Gets a FIFO queue.

getCacheQueue(String, Class<T>) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastCacheManager

getCacheQueue(String, Class<T>) - Method in class com.norconex.crawler.core.cluster.impl.memory.MemoryCacheManager

getCacheQueue(String, Class<T>) - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheManager

getCacheSet(String) - Method in interface com.norconex.crawler.core.cluster.CacheManager

As string-based set, keeping only unique keys.

getCacheSet(String) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastCacheManager

getCacheSet(String) - Method in class com.norconex.crawler.core.cluster.impl.memory.MemoryCacheManager

getCacheSet(String) - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheManager

getCacheSize() - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreClusterConnectorConfig

The cache size in MB.

getCacheSize() - Method in class com.norconex.crawler.web.doc.operations.image.impl.ImageCache

Returns the number of images currently in the cache.

getCacheType() - Method in class com.norconex.crawler.core.cluster.SerializedCache

getCacheTypes() - Method in class com.norconex.crawler.core.context.CrawlerContext

Map of map-config name/pattern to concrete value type, used to bake the correct (de)serialization class into the config before startup.

getCallbacks() - Method in class com.norconex.crawler.core.context.CrawlerContext

getCanonicalLinkDetector() - Method in class com.norconex.crawler.web.WebCrawlerConfig

The canonical link detector.

getCapabilities() - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig

Gets optional capabilities (configuration options) for the web driver.

getCaseType() - Method in class com.norconex.importer.handler.transformer.impl.CharacterCaseTransformerConfig

The type of character case transformation.

getChainedProxy() - Method in class com.norconex.crawler.web.fetch.impl.webdriver.HttpSnifferConfig

Gets chained proxy settings, if any.

getChangeDiscovery() - Method in class com.norconex.crawler.core.CrawlerConfig

Change discovery strategy.

getChannel() - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcherConfig

Optional browser channel that instructs Playwright to use a system-installed browser instead of its own downloaded binaries.

getCharset() - Method in class com.norconex.crawler.core.ledger.CrawlerEntry

getCharset() - Method in class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractorConfig

The assumed source character encoding.

getCharset() - Method in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractorConfig

The character set to use for pages on which link extraction is performed.

getCharset() - Method in class com.norconex.crawler.web.doc.operations.link.impl.RegexLinkExtractorConfig

Gets the character set of pages on which link extraction is performed.

getCharset() - Method in class com.norconex.importer.doc.Doc

getCharset() - Method in class com.norconex.importer.ImporterRequest

getChildPaths() - Method in class com.norconex.crawler.fs.fetch.AggregatedFolderPathsResponse

getChildPaths() - Method in interface com.norconex.crawler.fs.fetch.FolderPathsFetchResponse

The child paths of a folder path.

getChildPaths() - Method in class com.norconex.crawler.fs.fetch.impl.GenericFolderPathsFetchResponse

getChunkIndex() - Method in class com.norconex.importer.util.chunk.TextChunk

Index of the text portion currently processed.

getClassName() - Method in class com.norconex.crawler.core.cluster.SerializedCache

getClassName() - Method in class com.norconex.crawler.core.cluster.SerializedRecord

getCleanupInterval() - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcherConfig

Interval between checks for idle (unused) browser instances to close.

getCleanupInterval() - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig

Amount of time between each check for unused browser instances and closing them.

getClientEmail() - Method in class com.norconex.crawler.fs.fetch.impl.googledrive.GoogleDriveFetcherConfig

Service account client email.

getClientId() - Method in class com.norconex.crawler.fs.fetch.impl.m365graph.M365GraphFetcherConfig

Azure AD application (client) ID.

getClientId() - Method in class com.norconex.importer.handler.splitter.impl.TranslatorSplitterConfig

Microsoft API client id.

getClientSecret() - Method in class com.norconex.crawler.fs.fetch.impl.m365graph.M365GraphFetcherConfig

Azure AD client secret.

getClientSecret() - Method in class com.norconex.importer.handler.splitter.impl.TranslatorSplitterConfig

Microsoft API client secret.

getClosed() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.pipeline.PipelineCoordinatorState

getClosed() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.pipeline.PipelineWorkerState

getCluster() - Method in class com.norconex.crawler.core.session.CrawlerSession

getClusterConfig() - Method in class com.norconex.crawler.core.CrawlerConfig

The Importer module configuration.

getClusterName() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastClusterConnectorConfig

Cluster name for Hazelcast instance.

getColorSpace() - Method in class com.norconex.importer.handler.parser.impl.OcrConfig

getColumnKeyType() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.JdbcHazelcastConfigurer

SQL column type for map/queue keys.

getColumns() - Method in class com.norconex.committer.core.fs.impl.CsvFileCommitterConfig

getColumnValueType() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.JdbcHazelcastConfigurer

SQL column type for map values.

getCommand() - Method in class com.norconex.importer.handler.transformer.impl.ExternalTransformerConfig

The command to execute.

getCommandClass() - Method in class com.norconex.crawler.core.event.CrawlerEvent

The command class firing a CrawlerEvent.CRAWLER_COMMAND_BEGIN or CrawlerEvent.CRAWLER_COMMAND_END event, or null for all other events.

getCommitterContext() - Method in class com.norconex.committer.core.AbstractCommitter

getCommitterPipeline() - Method in class com.norconex.crawler.core.doc.pipelines.CrawlerDocPipelines

getCommitters() - Method in class com.norconex.committer.core.service.CommitterService

getCommitters() - Method in class com.norconex.committer.core.service.CommitterServiceEvent

getCommitters() - Method in class com.norconex.crawler.core.CrawlerConfig

Gets Committers responsible for persisting information to a target location/repository.

getCommitterService() - Method in class com.norconex.crawler.core.context.CrawlerContext

getCompactClass() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.JacksonCompactSerializer

getCompactClass() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.StepRecordCompactSerializer

getCompress() - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreClusterConnectorConfig

The compression level (0=off, 1=fast/LZF, 2=high/Deflate).

getCompression() - Method in class com.norconex.crawler.fs.fetch.impl.sftp.SftpFetcherConfig

getCondition() - Method in class com.norconex.importer.handler.condition.ConditionalDocHandler

getConditions() - Method in class com.norconex.importer.handler.condition.ConditionGroup

getConditionZoneId() - Method in class com.norconex.importer.handler.condition.impl.DateConditionConfig

Default time zone id applied to condition dates that do not specify their own (i.e., value matchers without an explicit zoneId and whose date string carries no zone).

getConfigFile() - Method in class com.norconex.crawler.core.cli.CliBase

getConfiguration() - Method in class com.norconex.committer.amazoncloudsearch.AmazonCloudSearchCommitter

getConfiguration() - Method in class com.norconex.committer.apachekafka.ApacheKafkaCommitter

getConfiguration() - Method in class com.norconex.committer.azurecognitivesearch.AzureSearchCommitter

getConfiguration() - Method in class com.norconex.committer.core.batch.queue.impl.FsQueue

getConfiguration() - Method in class com.norconex.committer.core.fs.impl.CsvFileCommitter

getConfiguration() - Method in class com.norconex.committer.core.fs.impl.JsonFileCommitter

getConfiguration() - Method in class com.norconex.committer.core.fs.impl.XmlFileCommitter

getConfiguration() - Method in class com.norconex.committer.core.impl.LogCommitter

getConfiguration() - Method in class com.norconex.committer.core.impl.MemoryCommitter

getConfiguration() - Method in class com.norconex.committer.elasticsearch.ElasticsearchCommitter

getConfiguration() - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitter

getConfiguration() - Method in class com.norconex.committer.idol.IdolCommitter

getConfiguration() - Method in class com.norconex.committer.neo4j.Neo4jCommitter

getConfiguration() - Method in class com.norconex.committer.solr.SolrCommitter

getConfiguration() - Method in class com.norconex.committer.sql.SqlCommitter

getConfiguration() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastCluster

getConfiguration() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastClusterConnector

getConfiguration() - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreClusterConnector

getConfiguration() - Method in class com.norconex.crawler.core.doc.operations.checksum.impl.GenericMetadataChecksummer

getConfiguration() - Method in class com.norconex.crawler.core.doc.operations.checksum.impl.Md5DocumentChecksummer

getConfiguration() - Method in class com.norconex.crawler.core.doc.operations.filter.impl.ExtensionReferenceFilter

getConfiguration() - Method in class com.norconex.crawler.core.doc.operations.filter.impl.GenericMetadataFilter

getConfiguration() - Method in class com.norconex.crawler.core.doc.operations.filter.impl.GenericReferenceFilter

getConfiguration() - Method in class com.norconex.crawler.core.doc.operations.spoil.impl.GenericSpoiledReferenceStrategizer

getConfiguration() - Method in class com.norconex.crawler.core.event.listeners.DeleteRejectedEventListener

getConfiguration() - Method in class com.norconex.crawler.core.event.listeners.StopCrawlerOnMaxEventListener

getConfiguration() - Method in class com.norconex.crawler.fs.doc.operations.checksum.FsMetadataChecksummer

getConfiguration() - Method in class com.norconex.crawler.fs.fetch.impl.adlsgen2.AdlsGen2Fetcher

getConfiguration() - Method in class com.norconex.crawler.fs.fetch.impl.archive.ArchiveFetcher

getConfiguration() - Method in class com.norconex.crawler.fs.fetch.impl.azureblob.AzureBlobFetcher

getConfiguration() - Method in class com.norconex.crawler.fs.fetch.impl.box.BoxFetcher

getConfiguration() - Method in class com.norconex.crawler.fs.fetch.impl.cmis.CmisFetcher

getConfiguration() - Method in class com.norconex.crawler.fs.fetch.impl.egnyte.EgnyteFetcher

getConfiguration() - Method in class com.norconex.crawler.fs.fetch.impl.ftp.FtpFetcher

getConfiguration() - Method in class com.norconex.crawler.fs.fetch.impl.gcs.GcsFetcher

getConfiguration() - Method in class com.norconex.crawler.fs.fetch.impl.googledrive.GoogleDriveFetcher

getConfiguration() - Method in class com.norconex.crawler.fs.fetch.impl.hdfs.HdfsFetcher

getConfiguration() - Method in class com.norconex.crawler.fs.fetch.impl.local.LocalFetcher

getConfiguration() - Method in class com.norconex.crawler.fs.fetch.impl.m365graph.M365GraphFetcher

getConfiguration() - Method in class com.norconex.crawler.fs.fetch.impl.s3.S3Fetcher

getConfiguration() - Method in class com.norconex.crawler.fs.fetch.impl.sftp.SftpFetcher

getConfiguration() - Method in class com.norconex.crawler.fs.fetch.impl.smb.SmbFetcher

getConfiguration() - Method in class com.norconex.crawler.fs.fetch.impl.webdav.WebDavFetcher

getConfiguration() - Method in class com.norconex.crawler.web.doc.operations.canon.impl.GenericCanonicalLinkDetector

getConfiguration() - Method in class com.norconex.crawler.web.doc.operations.checksum.impl.LastModifiedMetadataChecksummer

getConfiguration() - Method in class com.norconex.crawler.web.doc.operations.delay.impl.GenericDelayResolver

getConfiguration() - Method in class com.norconex.crawler.web.doc.operations.delay.impl.ReferenceDelayResolver

getConfiguration() - Method in class com.norconex.crawler.web.doc.operations.filter.impl.SegmentCountUrlFilter

getConfiguration() - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolver

getConfiguration() - Method in class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractor

getConfiguration() - Method in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractor

getConfiguration() - Method in class com.norconex.crawler.web.doc.operations.link.impl.RegexLinkExtractor

getConfiguration() - Method in class com.norconex.crawler.web.doc.operations.link.impl.TikaLinkExtractor

getConfiguration() - Method in class com.norconex.crawler.web.doc.operations.link.impl.XmlFeedLinkExtractor

getConfiguration() - Method in class com.norconex.crawler.web.doc.operations.recrawl.impl.GenericRecrawlableResolver

getConfiguration() - Method in class com.norconex.crawler.web.doc.operations.robot.impl.StandardRobotsMetaProvider

getConfiguration() - Method in class com.norconex.crawler.web.doc.operations.scope.impl.GenericUrlScopeResolver

getConfiguration() - Method in class com.norconex.crawler.web.doc.operations.sitemap.impl.GenericSitemapLocator

getConfiguration() - Method in class com.norconex.crawler.web.doc.operations.sitemap.impl.GenericSitemapResolver

getConfiguration() - Method in class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizer

getConfiguration() - Method in class com.norconex.crawler.web.event.listeners.UrlStatusCrawlerEventListener

getConfiguration() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcher

getConfiguration() - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcher

getConfiguration() - Method in class com.norconex.crawler.web.fetch.impl.webdriver.HttpSniffer

getConfiguration() - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcher

getConfiguration() - Method in class com.norconex.crawler.web.fetch.util.AbstractScreenshotHandler

getConfiguration() - Method in class com.norconex.crawler.web.fetch.util.DocImageHandler

getConfiguration() - Method in class com.norconex.crawler.web.fetch.util.GenericRedirectUrlProvider

getConfiguration() - Method in class com.norconex.importer.handler.condition.impl.BlankCondition

getConfiguration() - Method in class com.norconex.importer.handler.condition.impl.DateCondition

getConfiguration() - Method in class com.norconex.importer.handler.condition.impl.DomCondition

getConfiguration() - Method in class com.norconex.importer.handler.condition.impl.NumericCondition

getConfiguration() - Method in class com.norconex.importer.handler.condition.impl.ReferenceCondition

getConfiguration() - Method in class com.norconex.importer.handler.condition.impl.ScriptCondition

getConfiguration() - Method in class com.norconex.importer.handler.condition.impl.TextCondition

getConfiguration() - Method in class com.norconex.importer.handler.parser.impl.DefaultParser

getConfiguration() - Method in class com.norconex.importer.handler.parser.impl.ExternalParser

getConfiguration() - Method in class com.norconex.importer.handler.parser.impl.TikaParser

getConfiguration() - Method in class com.norconex.importer.handler.Reject

getConfiguration() - Method in class com.norconex.importer.handler.splitter.impl.CsvSplitter

getConfiguration() - Method in class com.norconex.importer.handler.splitter.impl.DomSplitter

getConfiguration() - Method in class com.norconex.importer.handler.splitter.impl.PdfPageSplitter

getConfiguration() - Method in class com.norconex.importer.handler.splitter.impl.TranslatorSplitter

getConfiguration() - Method in class com.norconex.importer.handler.splitter.impl.XmlStreamSplitter

getConfiguration() - Method in class com.norconex.importer.handler.transformer.impl.BinaryContentTransformer

getConfiguration() - Method in class com.norconex.importer.handler.transformer.impl.CharacterCaseTransformer

getConfiguration() - Method in class com.norconex.importer.handler.transformer.impl.CharsetTransformer

getConfiguration() - Method in class com.norconex.importer.handler.transformer.impl.CollapseRepeatingTransformer

getConfiguration() - Method in class com.norconex.importer.handler.transformer.impl.ConstantTransformer

getConfiguration() - Method in class com.norconex.importer.handler.transformer.impl.CopyTransformer

getConfiguration() - Method in class com.norconex.importer.handler.transformer.impl.CountMatchesTransformer

getConfiguration() - Method in class com.norconex.importer.handler.transformer.impl.CurrentDateTransformer

getConfiguration() - Method in class com.norconex.importer.handler.transformer.impl.DateFormatTransformer

getConfiguration() - Method in class com.norconex.importer.handler.transformer.impl.DebugTransformer

getConfiguration() - Method in class com.norconex.importer.handler.transformer.impl.DeleteTransformer

getConfiguration() - Method in class com.norconex.importer.handler.transformer.impl.DocumentLengthTransformer

getConfiguration() - Method in class com.norconex.importer.handler.transformer.impl.DomTransformer

getConfiguration() - Method in class com.norconex.importer.handler.transformer.impl.ExternalTransformer

getConfiguration() - Method in class com.norconex.importer.handler.transformer.impl.FieldReportTransformer

getConfiguration() - Method in class com.norconex.importer.handler.transformer.impl.ForceSingleValueTransformer

getConfiguration() - Method in class com.norconex.importer.handler.transformer.impl.HierarchyTransformer

getConfiguration() - Method in class com.norconex.importer.handler.transformer.impl.ImageTransformer

getConfiguration() - Method in class com.norconex.importer.handler.transformer.impl.KeepOnlyTransformer

getConfiguration() - Method in class com.norconex.importer.handler.transformer.impl.LanguageTransformer

getConfiguration() - Method in class com.norconex.importer.handler.transformer.impl.MergeTransformer

getConfiguration() - Method in class com.norconex.importer.handler.transformer.impl.RegexTransformer

getConfiguration() - Method in class com.norconex.importer.handler.transformer.impl.RenameTransformer

getConfiguration() - Method in class com.norconex.importer.handler.transformer.impl.ReplaceTransformer

getConfiguration() - Method in class com.norconex.importer.handler.transformer.impl.SaveDocumentTransformer

getConfiguration() - Method in class com.norconex.importer.handler.transformer.impl.ScriptTransformer

getConfiguration() - Method in class com.norconex.importer.handler.transformer.impl.SplitTransformer

getConfiguration() - Method in class com.norconex.importer.handler.transformer.impl.StripAfterTransformer

getConfiguration() - Method in class com.norconex.importer.handler.transformer.impl.StripBeforeTransformer

getConfiguration() - Method in class com.norconex.importer.handler.transformer.impl.StripBetweenTransformer

getConfiguration() - Method in class com.norconex.importer.handler.transformer.impl.SubstringTransformer

getConfiguration() - Method in class com.norconex.importer.handler.transformer.impl.TextBetweenTransformer

getConfiguration() - Method in class com.norconex.importer.handler.transformer.impl.TextStatisticsTransformer

getConfiguration() - Method in class com.norconex.importer.handler.transformer.impl.TitleGeneratorTransformer

getConfiguration() - Method in class com.norconex.importer.handler.transformer.impl.TruncateTransformer

getConfiguration() - Method in class com.norconex.importer.handler.transformer.impl.UrlExtractorTransformer

getConfiguration() - Method in class com.norconex.importer.handler.transformer.impl.UuidTransformer

getConfiguration() - Method in class com.norconex.importer.Importer

getConfigurer() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastClusterConnectorConfig

The configurer responsible for building the Hazelcast Config.

getConnection() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.jdbc.JdbcClient

getConnectionRequestTimeout() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

Gets the timeout when requesting a connection.

getConnectionTimeout() - Method in class com.norconex.committer.elasticsearch.ElasticsearchCommitterConfig

Elasticsearch connection timeout.

getConnectionTimeout() - Method in class com.norconex.crawler.fs.fetch.impl.webdav.WebDavFetcherConfig

getConnectionTimeout() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

The connection timeout for a connection to be established.

getConnectionUrl() - Method in class com.norconex.committer.sql.SqlCommitterConfig

JDBC connection URL.

getConnector() - Method in class com.norconex.crawler.core.cluster.ClusterConfig

The connector to the cluster implementation used to run the crawler.

getConnectorName() - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig

The connector name sent with indexing requests.

getConnectTimeout() - Method in class com.norconex.crawler.fs.fetch.impl.ftp.FtpFetcherConfig

getConnectTimeout() - Method in class com.norconex.crawler.fs.fetch.impl.sftp.SftpFetcherConfig

getConstants() - Method in class com.norconex.importer.handler.transformer.impl.ConstantTransformerConfig

Get constants to be added as metadata fields.

getConsumer() - Method in enum class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizerConfig.Normalization

getContent() - Method in class com.norconex.committer.core.UpsertRequest

getContentAsString(CommitterRequest) - Static method in class com.norconex.committer.core.CommitterUtil

Gets the request content as a string.

getContentChecksum() - Method in class com.norconex.crawler.core.ledger.CrawlerEntry

Gets the content checksum.

getContentColumns() - Method in class com.norconex.importer.handler.splitter.impl.CsvSplitterConfig

One or several columns containing the text to be considered as the document "content".

getContentHandler(ContentHandler, Metadata, ParseContext) - Method in class com.norconex.importer.handler.parser.impl.XfdlTikaParser

getContentType() - Method in class com.norconex.crawler.core.ledger.CrawlerEntry

getContentType() - Method in class com.norconex.importer.doc.Doc

getContentType() - Method in class com.norconex.importer.ImporterRequest

getContentTypeMatcher() - Method in class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractorConfig

The matcher of content types to apply link extraction on.

getContentTypeMatcher() - Method in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractorConfig

The matcher of content types to apply link extraction on.

getContentTypeMatcher() - Method in class com.norconex.crawler.web.doc.operations.link.impl.RegexLinkExtractorConfig

The matcher of content types to apply link extraction on.

getContentTypeMatcher() - Method in class com.norconex.crawler.web.doc.operations.link.impl.TikaLinkExtractorConfig

The matcher of content types to apply link extraction on.

getContentTypeMatcher() - Method in class com.norconex.crawler.web.doc.operations.link.impl.XmlFeedLinkExtractorConfig

The matcher of content types to apply link extraction on.

getContentTypeMatcher() - Method in class com.norconex.importer.handler.condition.impl.DomConditionConfig

Gets this condition content-type matcher.

getContentTypeMatcher() - Method in class com.norconex.importer.handler.parser.impl.OcrConfig

getContentTypeMatcher() - Method in class com.norconex.importer.handler.splitter.impl.DomSplitterConfig

The matcher of content types to apply splitting on.

getContentTypeMatcher() - Method in class com.norconex.importer.handler.splitter.impl.PdfPageSplitterConfig

The matcher of content types to apply splitting on.

getContentTypeMatcher() - Method in class com.norconex.importer.handler.splitter.impl.XmlStreamSplitterConfig

The matcher of content types to apply splitting on.

getContentTypeMatcher() - Method in class com.norconex.importer.handler.transformer.impl.DomTransformerConfig

The matcher of content types to apply transformation on.

getContentTypeMatcher() - Method in class com.norconex.importer.handler.transformer.impl.ImageTransformerConfig

The matcher of content types to apply transformation on.

getContentTypes() - Method in class com.norconex.crawler.web.doc.operations.canon.impl.GenericCanonicalLinkDetectorConfig

getContextAdapter() - Method in class com.norconex.crawler.core.doc.pipelines.committer.CommitterPipeline

getContextAdapter() - Method in class com.norconex.crawler.core.doc.pipelines.importer.ImporterPipeline

getContextAdapter() - Method in class com.norconex.crawler.core.doc.pipelines.queue.QueuePipeline

getControlEncoding() - Method in class com.norconex.crawler.fs.fetch.impl.ftp.FtpFetcherConfig

getControlKeepAliveReplyTimeout() - Method in class com.norconex.crawler.fs.fetch.impl.ftp.FtpFetcherConfig

getControlKeepAliveTimeout() - Method in class com.norconex.crawler.fs.fetch.impl.ftp.FtpFetcherConfig

getCookieSpec() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

Cookie specification to use when fetching documents.

getCount() - Method in class com.norconex.crawler.web.doc.operations.filter.impl.SegmentCountUrlFilterConfig

Number of segments after which this filter is considered a match.

getCountMatcher() - Method in class com.norconex.importer.handler.transformer.impl.CountMatchesTransformerConfig

Gets the count matcher.

getCrawlConfig() - Method in class com.norconex.crawler.core.context.CrawlerContext

getCrawlConfig() - Method in class com.norconex.crawler.core.Crawler

getCrawlContext() - Method in class com.norconex.crawler.core.session.CrawlerSession

getCrawlDate() - Method in class com.norconex.crawler.web.doc.operations.sitemap.SitemapRecord

getCrawlDelay() - Method in class com.norconex.crawler.web.doc.operations.robot.RobotsTxt

getCrawlDocContext() - Method in class com.norconex.crawler.web.fetch.WebFetchRequest

The crawl doc context, providing access to the current and previous crawl entries (e.g. for ETag and If-Modified-Since support).

getCrawlDriver() - Method in class com.norconex.crawler.core.cli.CliRunner

getCrawlDriver() - Method in class com.norconex.crawler.core.Crawler

getCrawlEntry() - Method in class com.norconex.crawler.core.doc.pipelines.queue.QueuePipelineContext

getCrawlEntry() - Method in class com.norconex.crawler.core.event.CrawlerEvent

Gets the document being processed associated with this event.

getCrawlEntryLedger() - Method in class com.norconex.crawler.core.context.CrawlerContext

getCrawlEntryType() - Method in class com.norconex.crawler.core.context.CrawlerContext

getCrawlerAttributes() - Method in class com.norconex.crawler.core.session.CrawlerSession

getCrawlerCache() - Method in interface com.norconex.crawler.core.cluster.CacheManager

Gets a generic shared cache bound to a crawler that persists forever (never deleted).

getCrawlerCache() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastCacheManager

getCrawlerCache() - Method in class com.norconex.crawler.core.cluster.impl.memory.MemoryCacheManager

getCrawlerCache() - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheManager

getCrawlerId() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastCluster

getCrawlerId() - Method in class com.norconex.crawler.core.session.CrawlerRunInfo

Stable identity of a crawler.

getCrawlerId() - Method in class com.norconex.crawler.core.session.CrawlerSession

The crawler unique identifier, for a specific crawler setup and does not change across sessions.

getCrawlMode() - Method in class com.norconex.crawler.core.session.CrawlerRunInfo

The mode used to crawl web sites.

getCrawlResumeState() - Method in class com.norconex.crawler.core.session.CrawlerRunInfo

Whether we are starting a new crawl session or resuming a previous one.

getCrawlRunAttributes() - Method in class com.norconex.crawler.core.session.CrawlerRunCoordinator

Returns the run-scoped attribute store backed by the run cache.

getCrawlRunAttributes() - Method in class com.norconex.crawler.core.session.CrawlerSession

getCrawlRunCache() - Method in interface com.norconex.crawler.core.cluster.CacheManager

Gets a generic shared cache tied to a specific crawler run and does not get persisted when the crawler run terminates.

getCrawlRunCache() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastCacheManager

getCrawlRunCache() - Method in class com.norconex.crawler.core.cluster.impl.memory.MemoryCacheManager

getCrawlRunCache() - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheManager

getCrawlRunId() - Method in class com.norconex.crawler.core.session.CrawlerRunInfo

Unique identifier for each time the crawler starts (until termination).

getCrawlRunId() - Method in class com.norconex.crawler.core.session.CrawlerSession

A crawl run unique identifier, which is renewed every time the crawler is launched, regardless whether we are resuming an existing session or creating a new one.

getCrawlSession() - Method in interface com.norconex.crawler.core.cluster.Cluster

Returns the crawl session bound to this cluster node, or null if the session has not been bound yet.

getCrawlSession() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastCluster

getCrawlSession() - Method in class com.norconex.crawler.core.cluster.impl.memory.MemoryCluster

getCrawlSession() - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCluster

getCrawlSession() - Method in class com.norconex.crawler.core.cmd.crawl.pipeline.bootstrap.queue.QueueBootstrapContext

getCrawlSession() - Method in class com.norconex.crawler.core.doc.pipelines.committer.CommitterPipelineContext

getCrawlSession() - Method in class com.norconex.crawler.core.doc.pipelines.importer.ImporterPipelineContext

getCrawlSession() - Method in class com.norconex.crawler.core.doc.pipelines.queue.QueuePipelineContext

getCrawlSession() - Method in class com.norconex.crawler.core.event.CrawlerEvent

getCrawlSessionCache() - Method in interface com.norconex.crawler.core.cluster.CacheManager

Gets a generic shared cache bound to a crawl session that persists until a new crawl session is started (for the same crawler).

getCrawlSessionCache() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastCacheManager

getCrawlSessionCache() - Method in class com.norconex.crawler.core.cluster.impl.memory.MemoryCacheManager

getCrawlSessionCache() - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheManager

getCrawlSessionId() - Method in class com.norconex.crawler.core.session.CrawlerRunInfo

Full life-cycle identifier for a single crawl.

getCrawlSessionId() - Method in class com.norconex.crawler.core.session.CrawlerSession

A crawl session unique identifier, which represents a begin-to-end crawl, regardless how many times it may have been resumed due to stops or failures.

getCrawlState() - Method in class com.norconex.crawler.core.session.CrawlerSession

getCrawlState() - Method in class com.norconex.crawler.core.session.CrawlerSession.State

getCrawlState() - Method in class com.norconex.crawler.core.session.CrawlerStateStore

Returns the current crawl state, reading fresh from the distributed cache each call.

getCreateFieldSQL() - Method in class com.norconex.committer.sql.SqlCommitterConfig

The ALTER statement used to create missing table fields.

getCreateTableSQL() - Method in class com.norconex.committer.sql.SqlCommitterConfig

The CREATE statement used to create a table if it does not already exist.

getCredentials() - Method in class com.norconex.committer.elasticsearch.ElasticsearchCommitterConfig

Gets Elasticsearch authentication credentials.

getCredentials() - Method in class com.norconex.committer.neo4j.Neo4jCommitterConfig

Connection credentials.

getCredentials() - Method in class com.norconex.committer.solr.SolrCommitterConfig

Gets Solr authentication credentials.

getCredentials() - Method in class com.norconex.committer.sql.SqlCommitterConfig

getCredentials() - Method in class com.norconex.crawler.fs.fetch.impl.BaseAuthNioFetcherConfig

getCredentials() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthConfig

getCrop() - Method in class com.norconex.importer.handler.transformer.impl.ImageTransformerConfig

getCssSelector() - Method in class com.norconex.crawler.web.fetch.util.ScreenshotHandlerConfig

getCurrentCrawlEntry() - Method in class com.norconex.crawler.core.doc.CrawlerDocContext

getCurrentStep() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.pipeline.PipelineCoordinatorState

getCurrentStep() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.pipeline.PipelineWorkerState

getCurrentStepId() - Method in class com.norconex.crawler.core.cluster.pipeline.PipelineProgress

getCurrentStepId() - Method in class com.norconex.crawler.core.cluster.pipeline.PipelineProgressBean

getCurrentStepId() - Method in interface com.norconex.crawler.core.cluster.pipeline.PipelineProgressMXBean

getCurrentStepIndex() - Method in class com.norconex.crawler.core.cluster.pipeline.PipelineProgress

getCurrentStepIndex() - Method in class com.norconex.crawler.core.cluster.pipeline.PipelineProgressBean

getCurrentStepIndex() - Method in interface com.norconex.crawler.core.cluster.pipeline.PipelineProgressMXBean

getCurrentStepRecord() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.pipeline.PipelineCoordinatorState

getCurrentStepRecord() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.pipeline.PipelineWorkerState

getDaemonThreadCount() - Static method in class com.norconex.crawler.core.util.ThreadTracker

getDatabase() - Method in class com.norconex.committer.neo4j.Neo4jCommitterConfig

A database name when using one other than the default one.

getDatabaseName() - Method in class com.norconex.committer.idol.IdolCommitterConfig

The IDOL database name.

getDataChannelProtectionLevel() - Method in class com.norconex.crawler.fs.fetch.impl.ftp.FtpFetcherConfig

getDataSource() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.jdbc.JdbcClient

getDataSourceId() - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig

The Google Cloud Search data source ID to index documents into.

getDataTimeout() - Method in class com.norconex.crawler.fs.fetch.impl.ftp.FtpFetcherConfig

getDateExpression() - Method in class com.norconex.importer.handler.condition.impl.DateValueMatcher

Original date expression and explicitly-supplied zone id (if any), retained so a condition-level default zone can be applied later to matchers that did not specify their own.

getDateProvider() - Method in class com.norconex.importer.handler.condition.impl.DateValueMatcher

getDateTime() - Method in interface com.norconex.importer.handler.condition.impl.DateProvider

Static or dynamic date-time.

getDateTime() - Method in class com.norconex.importer.handler.condition.impl.DateProviderFactory.DynamicFixedDateTimeProvider

getDateTime() - Method in class com.norconex.importer.handler.condition.impl.DateProviderFactory.DynamicFloatingDateTimeProvider

getDateTime() - Method in class com.norconex.importer.handler.condition.impl.DateProviderFactory.StaticDateTimeProvider

getDayOfMonthRange() - Method in class com.norconex.crawler.web.doc.operations.delay.impl.DelaySchedule

getDayOfWeekRange() - Method in class com.norconex.crawler.web.doc.operations.delay.impl.DelaySchedule

getDedupService() - Method in class com.norconex.crawler.core.context.CrawlerContext

getDefaultDateFormat() - Method in class com.norconex.crawler.fs.fetch.impl.ftp.FtpFetcherConfig

getDefaultDelay() - Method in class com.norconex.crawler.web.doc.operations.delay.impl.BaseDelayResolverConfig

The default delay.

getDefaultFileName() - Method in class com.norconex.importer.handler.transformer.impl.SaveDocumentTransformerConfig

getDefaultValue() - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.MetadataMapping

Optional fallback value when GoogleCloudSearchCommitterConfig.MetadataMapping.fromField is missing or blank.

getDefaultValue() - Method in class com.norconex.importer.handler.transformer.impl.DomOperation

The value to store in the target field if there are no matches.

getDeferredShutdownDuration() - Method in class com.norconex.crawler.core.CrawlerConfig

The amount of time to defer the crawler shutdown when it is done executing.

getDelay() - Method in class com.norconex.crawler.web.doc.operations.delay.impl.DelayReferencePattern

getDelay() - Method in class com.norconex.crawler.web.doc.operations.delay.impl.DelaySchedule

getDelayReferencePatterns() - Method in class com.norconex.crawler.web.doc.operations.delay.impl.ReferenceDelayResolverConfig

getDelayResolver() - Method in class com.norconex.crawler.web.WebCrawlerConfig

The delay resolver dictating the minimum amount of time to wait between web requests.

getDelegate() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.event.CacheEntryChangeListenerAdapter

getDelegatedUser() - Method in class com.norconex.crawler.fs.fetch.impl.googledrive.GoogleDriveFetcherConfig

Optional delegated Google Workspace user email for domain-wide delegation.

getDeleteCount() - Method in class com.norconex.committer.core.impl.MemoryCommitter

getDeleteCypher() - Method in class com.norconex.committer.neo4j.Neo4jCommitterConfig

Cypher query for adding relationships to Neo4j.

getDeleteRequestBuilder() - Method in class com.norconex.committer.core.service.CommitterService

getDeleteRequests() - Method in class com.norconex.committer.core.impl.MemoryCommitter

getDelimiter() - Method in class com.norconex.committer.core.fs.impl.CsvFileCommitterConfig

Delimiter character to use.

getDensity() - Method in class com.norconex.importer.handler.parser.impl.OcrConfig

getDepth() - Method in class com.norconex.crawler.core.ledger.CrawlerEntry

Typically, the number of "hops" or directories to get to a file.

getDepth() - Method in class com.norconex.importer.handler.parser.impl.OcrConfig

getDescription() - Method in class com.norconex.importer.response.ImporterResponse

getDetectHeadingMaxLength() - Method in class com.norconex.importer.handler.transformer.impl.TitleGeneratorTransformerConfig

getDetectHeadingMinLength() - Method in class com.norconex.importer.handler.transformer.impl.TitleGeneratorTransformerConfig

getDetector() - Static method in class com.norconex.importer.doc.ContentTypeDetector

Returns the custom MIME type detector used for content type detection.

getDirectory() - Method in class com.norconex.committer.core.fs.BaseFsCommitterConfig

The directory where files are committed.

getDirSplitPattern() - Method in class com.norconex.importer.handler.transformer.impl.SaveDocumentTransformerConfig

getDisallowFilters() - Method in class com.norconex.crawler.web.doc.operations.robot.RobotsTxt

Gets "Disallow" filters.

getDoc() - Method in class com.norconex.crawler.core.doc.CrawlerDocContext

getDoc() - Method in interface com.norconex.crawler.core.fetch.FetchRequest

getDoc() - Method in class com.norconex.crawler.fs.fetch.FileFetchRequest

getDoc() - Method in class com.norconex.crawler.fs.fetch.FolderPathsFetchRequest

getDoc() - Method in class com.norconex.crawler.web.fetch.WebFetchRequest

getDoc() - Method in class com.norconex.importer.response.ImporterResponse

getDocContext() - Method in class com.norconex.crawler.core.doc.pipelines.committer.CommitterPipelineContext

getDocContext() - Method in class com.norconex.crawler.core.doc.pipelines.importer.ImporterPipelineContext

getDocPipelines() - Method in class com.norconex.crawler.core.context.CrawlerContext

getDocsPerFile() - Method in class com.norconex.committer.core.fs.BaseFsCommitterConfig

getDocument() - Method in class com.norconex.crawler.fs.fetch.impl.cmis.CmisFileAttributes

getDocument() - Method in class com.norconex.importer.ImporterEvent

Gets the document associated with this event, if applicable.

getDocument(String) - Method in class com.norconex.crawler.fs.fetch.impl.cmis.CmisAtomSession

getDocumentByPath(String) - Method in class com.norconex.crawler.fs.fetch.impl.cmis.CmisAtomSession

getDocumentChecksummer() - Method in class com.norconex.crawler.core.CrawlerConfig

The document checksummer.

getDocumentFetchSupport() - Method in class com.norconex.crawler.core.CrawlerConfig

getDocumentFilters() - Method in class com.norconex.crawler.core.CrawlerConfig

Gets the document filters.

getDocZoneId() - Method in class com.norconex.importer.handler.condition.impl.DateConditionConfig

Time zone id to use for dates associated with a document when evaluating date conditions.

getDomain() - Method in class com.norconex.crawler.fs.fetch.impl.BaseAuthNioFetcherConfig

getDomain() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthConfig

Gets the NTLM authentication domain.

getDomSelector() - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig

Optional CSS-like path matching one or more image elements.

getDotReplacement() - Method in class com.norconex.committer.elasticsearch.ElasticsearchCommitterConfig

The character used to replace dots in field names.

getDreAddDataParams() - Method in class com.norconex.committer.idol.IdolCommitterConfig

Gets the DREADDDATA optional URL parameters.

getDreDeleteRefParams() - Method in class com.norconex.committer.idol.IdolCommitterConfig

The DREDELETEREF optional URL parameters.

getDriver() - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverManager

Returns the Thread‑local WebDriver, creating (and registering) it on first call.

getDriverClass() - Method in class com.norconex.committer.sql.SqlCommitterConfig

Class name of the JDBC driver to use.

getDriverPath() - Method in class com.norconex.committer.sql.SqlCommitterConfig

Path to JDBC driver.

getDriverPath() - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig

Local path to driver executable or null to attempt automatic detection of the driver path.

getEarlyPageScript() - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcherConfig

Optional JavaScript code executed immediately after page navigation, before any wait conditions are applied.

getEarlyPageScript() - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig

Optional JavaScript code to be run the moment a page is requested.

getElementValue(Element, String) - Static method in class com.norconex.importer.util.DomUtil

Gets an element value based on JSoup DOM.

getElseHandlers() - Method in class com.norconex.importer.handler.condition.ConditionalDocHandler

getEmbeddedConfig() - Method in class com.norconex.importer.handler.parser.impl.DefaultParserConfig

getEnableImagePreprocessing() - Method in class com.norconex.importer.handler.parser.impl.OcrConfig

getEncounteredSteps() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.pipeline.PipelineWorkerState

getEnd() - Method in class com.norconex.crawler.web.doc.operations.delay.impl.DelayRange

getEnd() - Method in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractorConfig.RegexPair

getEnd() - Method in class com.norconex.importer.handler.transformer.impl.SubstringTransformerConfig

The end index (exclusive).

getEndMatcher() - Method in class com.norconex.importer.handler.transformer.impl.StripBetweenOperation

Gets the end delimiter matcher for text to strip.

getEndMatcher() - Method in class com.norconex.importer.handler.transformer.impl.TextBetweenOperation

Gets the end delimiter matcher for text to extract.

getEndpoint() - Method in class com.norconex.committer.azurecognitivesearch.AzureSearchCommitterConfig

Gets the Azure Search endpoint.

getEndpoint() - Method in class com.norconex.crawler.fs.fetch.impl.adlsgen2.AdlsGen2FetcherConfig

Optional service endpoint override.

getEndpoint() - Method in class com.norconex.crawler.fs.fetch.impl.azureblob.AzureBlobFetcherConfig

Optional service endpoint override.

getEndpoint() - Method in class com.norconex.crawler.fs.fetch.impl.gcs.GcsFetcherConfig

Optional endpoint override, mainly intended for GCS-compatible test servers such as fake-gcs-server.

getEndpoint() - Method in class com.norconex.crawler.fs.fetch.impl.s3.S3FetcherConfig

Custom endpoint URL, for S3-compatible services (e.g.

getEndpointURL() - Method in class com.norconex.crawler.fs.fetch.impl.cmis.CmisAtomSession

getEngineName() - Method in class com.norconex.importer.handler.condition.impl.ScriptConditionConfig

getEngineName() - Method in class com.norconex.importer.handler.ScriptRunner

getEngineName() - Method in class com.norconex.importer.handler.transformer.impl.ScriptTransformerConfig

getEntriesByStatus(ProcessingStatus) - Method in class com.norconex.crawler.core.ledger.CrawlerEntryLedger

Gets all entries matching the given processing status.

getEntry(String) - Method in class com.norconex.crawler.core.ledger.CrawlerEntryLedger

Gets the current ledger entry for the given reference, if it exists.

getEnvironmentVariables() - Method in class com.norconex.importer.handler.transformer.impl.ExternalTransformerConfig

Sets the environment variables.

getErrorsSaveDir() - Method in class com.norconex.importer.handler.parser.impl.DefaultParserConfig

getEscape() - Method in class com.norconex.committer.core.fs.impl.CsvFileCommitterConfig

Escape character.

getEscapeCharacter() - Method in class com.norconex.importer.handler.splitter.impl.CsvSplitterConfig

The escape character.

getEtag() - Method in class com.norconex.crawler.web.ledger.WebCrawlerEntry

The HTTP ETag.

getEventBus() - Method in class com.norconex.crawler.core.session.CrawlerSession

Fires events through the underlying event manager.

getEventCounts() - Method in class com.norconex.crawler.core.metrics.CrawlerMetricsImpl

getEventCounts() - Method in interface com.norconex.crawler.core.metrics.CrawlerMetricsMXBean

getEventListeners() - Method in class com.norconex.crawler.core.CrawlerConfig

Gets event listeners.

getEventManager() - Method in class com.norconex.committer.core.CommitterContext

getEventManager() - Method in class com.norconex.committer.core.service.CommitterService

getEventManager() - Method in class com.norconex.crawler.core.context.CrawlerContext

getEventManager() - Method in class com.norconex.importer.Importer

Gets the event manager.

getEventMatcher() - Method in class com.norconex.crawler.core.event.listeners.DeleteRejectedEventListenerConfig

Gets the event matcher used to identify which events can trigger a deletion request.

getEventMatcher() - Method in class com.norconex.crawler.core.event.listeners.StopCrawlerOnMaxEventListenerConfig

Gets the event matcher used to identify which events will be counted.

getException() - Method in class com.norconex.crawler.core.fetch.AggregatedFetchResponse

getException() - Method in interface com.norconex.crawler.core.fetch.FetchResponse

getException() - Method in class com.norconex.crawler.fs.fetch.impl.GenericFileFetchResponse

getException() - Method in class com.norconex.crawler.fs.fetch.impl.GenericFolderPathsFetchResponse

getException() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetchResponse

getException() - Method in class com.norconex.importer.response.ImporterResponse

getExecutablePath() - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcherConfig

Optional path to a custom browser executable.

getExecutionSummary() - Method in class com.norconex.crawler.core.cmd.crawl.CrawlerProgressLogger

getExplicitZoneId() - Method in class com.norconex.importer.handler.condition.impl.DateValueMatcher

getExportMimeTypeMap() - Method in class com.norconex.crawler.fs.fetch.impl.googledrive.GoogleDriveFetcherConfig

Explicit export overrides for Google-native document mime types.

getExtensions() - Method in class com.norconex.crawler.core.doc.operations.filter.impl.ExtensionReferenceFilterConfig

getExtraCapability(String) - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverBrowser.CustomDriverOptions

getExtraCapabilityNames() - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverBrowser.CustomDriverOptions

getExtract() - Method in class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractorConfig.LinkSelector

getExtract() - Method in class com.norconex.importer.handler.condition.impl.DomConditionConfig

Gets what should be extracted for the value.

getExtract() - Method in class com.norconex.importer.handler.transformer.impl.DomOperation

getExtractBetweens() - Method in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractorConfig

Gets the patterns delimiting the portions of a document to be considered for link extraction.

getExtractionPatterns() - Method in class com.norconex.importer.handler.transformer.impl.ExternalTransformerConfig

Gets metadata extraction patterns.

getExtractSelectors() - Method in class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractorConfig

getExtractSelectors() - Method in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractorConfig

Gets the selectors matching the portions of a document to be considered for link extraction.

getFactor() - Method in class com.norconex.importer.handler.transformer.impl.ImageTransformerConfig.Scale

getFallbackCharset() - Method in class com.norconex.crawler.web.fetch.util.GenericRedirectUrlProviderConfig

getFallbackLanguage() - Method in class com.norconex.importer.handler.transformer.impl.LanguageTransformerConfig

The fallback language when none are detected.

getFallbackStrategy() - Method in class com.norconex.crawler.core.doc.operations.spoil.impl.GenericSpoiledReferenceStrategizerConfig

getFetchDirective() - Method in class com.norconex.crawler.core.doc.pipelines.importer.stages.AbstractImporterStage

getFetchDirective() - Method in class com.norconex.crawler.fs.fetch.FileFetchRequest

getFetcher() - Method in class com.norconex.crawler.core.context.CrawlerContext

getFetcher() - Method in class com.norconex.crawler.web.doc.operations.sitemap.SitemapContext

getFetchers() - Method in class com.norconex.crawler.core.CrawlerConfig

One or more fetchers responsible for pulling documents and document metadata associated with a reference from a source.

getFetchers() - Method in class com.norconex.crawler.core.fetch.MultiFetcher

getFetchersMaxRetries() - Method in class com.norconex.crawler.core.CrawlerConfig

The maximum number of times a fetcher will re-attempt fetching a resource in case of failures.

getFetchersRetryDelay() - Method in class com.norconex.crawler.core.CrawlerConfig

How long to wait before a failing fetcher re-attempts fetching a resource in case of failures (in milliseconds).

getFetchResponses() - Method in class com.norconex.crawler.core.fetch.AggregatedFetchResponse

getField() - Method in class com.norconex.committer.core.fs.impl.CsvColumn

getField() - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.StructuredDataMapping

Metadata/structured-data field name this mapping applies to.

getField() - Method in class com.norconex.importer.util.chunk.TextChunk

The field name where the text is coming from.

getFieldMappings() - Method in class com.norconex.committer.core.BaseCommitterConfig

Gets an unmodifiable copy of the metadata mappings.

getFieldMatcher() - Method in class com.norconex.committer.core.impl.LogCommitterConfig

getFieldMatcher() - Method in class com.norconex.committer.core.impl.MemoryCommitterConfig

getFieldMatcher() - Method in class com.norconex.crawler.core.doc.operations.checksum.impl.GenericMetadataChecksummerConfig

The field matcher for one or more fields to be used as checksum.

getFieldMatcher() - Method in class com.norconex.crawler.core.doc.operations.checksum.impl.Md5DocumentChecksummerConfig

Matcher of one or more fields to use to make up the checksum.

getFieldMatcher() - Method in class com.norconex.crawler.core.doc.operations.filter.impl.GenericMetadataFilterConfig

Gets the field matcher.

getFieldMatcher() - Method in class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractorConfig

Matcher of one or more fields to use as the source of content to extract links from, instead of the document content.

getFieldMatcher() - Method in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractorConfig

Matcher of one or more fields to use as the source of content to extract links from, instead of the document content.

getFieldMatcher() - Method in class com.norconex.crawler.web.doc.operations.link.impl.RegexLinkExtractorConfig

Matcher of one or more fields to use as the source of content to extract links from, instead of the document content.

getFieldMatcher() - Method in class com.norconex.crawler.web.doc.operations.link.impl.TikaLinkExtractorConfig

Matcher of one or more fields to use as the source of content to extract links from, instead of the document content.

getFieldMatcher() - Method in class com.norconex.crawler.web.doc.operations.link.impl.XmlFeedLinkExtractorConfig

Matcher of one or more fields to use as the source of content to extract links from, instead of the document content.

getFieldMatcher() - Method in class com.norconex.importer.handler.condition.impl.BlankConditionConfig

getFieldMatcher() - Method in class com.norconex.importer.handler.condition.impl.DateConditionConfig

Field name(s) text matcher.

getFieldMatcher() - Method in class com.norconex.importer.handler.condition.impl.DomConditionConfig

Gets this filter field matcher.

getFieldMatcher() - Method in class com.norconex.importer.handler.condition.impl.NumericConditionConfig

Gets the text matcher of field names.

getFieldMatcher() - Method in class com.norconex.importer.handler.condition.impl.ScriptConditionConfig

Gets this filter field matcher.

getFieldMatcher() - Method in class com.norconex.importer.handler.condition.impl.TextConditionConfig

Gets the text matcher of field names.

getFieldMatcher() - Method in class com.norconex.importer.handler.splitter.impl.CsvSplitterConfig

Matcher of one or more fields to use as the source of content to split into new documents, instead of the original document content.

getFieldMatcher() - Method in class com.norconex.importer.handler.splitter.impl.DomSplitterConfig

Matcher of one or more fields to use as the source of content to split into new documents, instead of the original document content.

getFieldMatcher() - Method in class com.norconex.importer.handler.splitter.impl.TranslatorSplitterConfig

Optional matcher of fields holding content to translate instead of document body.

getFieldMatcher() - Method in class com.norconex.importer.handler.splitter.impl.XmlStreamSplitterConfig

Matcher of one or more fields to use as the source of content to split into new documents, instead of the original document content.

getFieldMatcher() - Method in class com.norconex.importer.handler.transformer.impl.CharacterCaseTransformerConfig

Optional matcher of fields to apply transformation to.

getFieldMatcher() - Method in class com.norconex.importer.handler.transformer.impl.CharsetTransformerConfig

Optional matcher of fields to convert the character set of their values.

getFieldMatcher() - Method in class com.norconex.importer.handler.transformer.impl.CollapseRepeatingTransformerConfig

Gets source field matcher for fields on which to perform repeating string collapsing.

getFieldMatcher() - Method in class com.norconex.importer.handler.transformer.impl.CopyOperation

One or more source field to copy to target field.

getFieldMatcher() - Method in class com.norconex.importer.handler.transformer.impl.CountMatchesTransformerConfig

Gets the field matcher.

getFieldMatcher() - Method in class com.norconex.importer.handler.transformer.impl.DeleteTransformerConfig

Gets field matcher for fields to delete.

getFieldMatcher() - Method in class com.norconex.importer.handler.transformer.impl.DomTransformerConfig

Matcher of one or more fields to use as the source of content to transforms, instead of the original document content.

getFieldMatcher() - Method in class com.norconex.importer.handler.transformer.impl.ForceSingleValueTransformerConfig

Gets field matcher.

getFieldMatcher() - Method in class com.norconex.importer.handler.transformer.impl.KeepOnlyTransformerConfig

Gets field matcher.

getFieldMatcher() - Method in class com.norconex.importer.handler.transformer.impl.LanguageTransformerConfig

Gets a matcher for fields to use to detect language.

getFieldMatcher() - Method in class com.norconex.importer.handler.transformer.impl.MergeOperation

Gets field matcher.

getFieldMatcher() - Method in class com.norconex.importer.handler.transformer.impl.RegexTransformerConfig

Gets source field matcher for fields on which to extract fields/values.

getFieldMatcher() - Method in class com.norconex.importer.handler.transformer.impl.RenameOperation

Gets source field matcher for fields to rename to the value of "toField".

getFieldMatcher() - Method in class com.norconex.importer.handler.transformer.impl.ReplaceOperation

Gets field matcher.

getFieldMatcher() - Method in class com.norconex.importer.handler.transformer.impl.ScriptTransformerConfig

Gets source field matcher for fields on which to execute a script.

getFieldMatcher() - Method in class com.norconex.importer.handler.transformer.impl.SplitOperation

Gets field matcher for fields to split.

getFieldMatcher() - Method in class com.norconex.importer.handler.transformer.impl.StripAfterTransformerConfig

Gets source field matcher for fields to transform.

getFieldMatcher() - Method in class com.norconex.importer.handler.transformer.impl.StripBeforeTransformerConfig

Gets source field matcher for fields to transform.

getFieldMatcher() - Method in class com.norconex.importer.handler.transformer.impl.StripBetweenTransformerConfig

Gets source field matcher for fields to transform.

getFieldMatcher() - Method in class com.norconex.importer.handler.transformer.impl.SubstringTransformerConfig

Gets source field matcher for fields to transform.

getFieldMatcher() - Method in class com.norconex.importer.handler.transformer.impl.TextBetweenOperation

Gets field matcher for fields on which to extract values.

getFieldMatcher() - Method in class com.norconex.importer.handler.transformer.impl.TextStatisticsTransformerConfig

Gets field matcher for fields to split.

getFieldMatcher() - Method in class com.norconex.importer.handler.transformer.impl.TitleGeneratorTransformerConfig

Gets source field matcher for fields to use to generate title.

getFieldMatcher() - Method in class com.norconex.importer.handler.transformer.impl.TruncateTransformerConfig

Gets the field matcher for fields to truncate.

getFieldMatcher() - Method in class com.norconex.importer.handler.transformer.impl.UrlExtractorTransformerConfig

Gets field matcher for fields containing text.

getFieldMatcher() - Method in interface com.norconex.importer.util.chunk.ChunkedTextSupport

getFieldName() - Method in class com.norconex.crawler.core.cluster.QueryFilter

getFieldName() - Method in class com.norconex.importer.handler.transformer.impl.BinaryContentTransformerConfig

Name of the metadata field to store the Base64-encoded raw content in.

getFields() - Method in class com.norconex.importer.handler.transformer.impl.FieldReportTransformer

getFieldValue() - Method in class com.norconex.crawler.core.cluster.QueryFilter

getFieldValueIndex() - Method in class com.norconex.importer.util.chunk.TextChunk

On multi-valued field, the index of the value currently processed.

getFile() - Method in class com.norconex.importer.handler.transformer.impl.FieldReportTransformerConfig

getFile() - Method in class com.norconex.importer.ImporterRequest

getFileAttributeView(Path, Class<V>, LinkOption...) - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyFileSystemProvider

getFileExtension() - Method in class com.norconex.committer.core.fs.AbstractFsCommitter

getFileExtension() - Method in class com.norconex.committer.core.fs.impl.CsvFileCommitter

getFileExtension() - Method in class com.norconex.committer.core.fs.impl.JsonFileCommitter

getFileExtension() - Method in class com.norconex.committer.core.fs.impl.XmlFileCommitter

getFileName() - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyPath

getFileNameEncoding() - Method in class com.norconex.crawler.fs.fetch.impl.sftp.SftpFetcherConfig

getFileNamePrefix() - Method in class com.norconex.committer.core.fs.BaseFsCommitterConfig

The file name prefix (default is null).

getFileNamePrefix() - Method in class com.norconex.crawler.web.event.listeners.UrlStatusCrawlerEventListenerConfig

The generated report file name prefix.

getFileNameSuffix() - Method in class com.norconex.committer.core.fs.BaseFsCommitterConfig

The file name suffix (default is null).

getFileStore(Path) - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyFileSystemProvider

getFileStores() - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyFileSystem

getFileSystem() - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyPath

getFilter() - Method in class com.norconex.importer.handler.parser.impl.OcrConfig

getFinishedAt() - Method in class com.norconex.crawler.core.cluster.pipeline.PipelineResult

getFirstStep() - Method in class com.norconex.crawler.core.cluster.pipeline.Pipeline

getFormat() - Method in class com.norconex.committer.core.fs.impl.CsvFileCommitterConfig

Optional base CSV formatter to use.

getFormat() - Method in class com.norconex.importer.handler.condition.impl.DateConditionConfig

The format of a document date field value (see class documentation).

getFormat() - Method in class com.norconex.importer.handler.transformer.impl.CurrentDateTransformerConfig

getFormCharset() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthConfig

The authentication form character set for the form field values.

getFormParam(String) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthConfig

Gets an authentication form parameter (equivalent to "input" or other fields in HTML forms).

getFormParamNames() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthConfig

Gets all authentication form parameter names.

getFormParams() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthConfig

Gets all authentication form parameters (equivalent to "input" or other fields in HTML forms).

getFormPasswordField() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthConfig

The name of the HTML field where the password is set.

getFormSelector() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthConfig

The CSS selector that identifies the form in a login page.

getFormUsernameField() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthConfig

The name of the HTML field where the username is set.

getFromField() - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.AclInheritanceMapping

Metadata field holding the parent item reference.

getFromField() - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.AclMapping

Metadata field holding the principal value(s).

getFromField() - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.MetadataMapping

Optional source metadata field in crawler documents.

getFromField() - Method in class com.norconex.importer.handler.transformer.impl.DateFormatTransformerConfig

getFromField() - Method in class com.norconex.importer.handler.transformer.impl.HierarchyOperation

getFromField() - Method in class com.norconex.importer.handler.transformer.impl.TitleGeneratorTransformerConfig

getFromFormats() - Method in class com.norconex.importer.handler.transformer.impl.DateFormatTransformerConfig

Gets the source date formats to match.

getFromLocale() - Method in class com.norconex.importer.handler.transformer.impl.DateFormatTransformerConfig

The locale used for parsing the source date.

getFromSeparator() - Method in class com.norconex.importer.handler.transformer.impl.HierarchyOperation

getGraphBaseUrl() - Method in class com.norconex.crawler.fs.fetch.impl.m365graph.M365GraphFetcherConfig

Microsoft Graph v1 endpoint root.

getGrobidConfig() - Method in class com.norconex.importer.handler.parser.impl.DefaultParserConfig

getHandlers() - Method in class com.norconex.importer.ImporterConfig

getHazelcastInstance() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.jdbc.TypedJdbcMapStoreFactory

getHazelcastInstance() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.jdbc.TypedJdbcQueueStoreFactory

getHazelcastInstance() - Method in interface com.norconex.crawler.core.cluster.impl.hazelcast.LazyTypedStoreFactory

getHazelcastInstance(String) - Static method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastCacheManager

Returns the HazelcastInstance with the given name using Hazelcast's own instance registry.

getHazelcastProperties() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.JdbcHazelcastConfigurer

Additional Hazelcast system properties set on the config (e.g.

getHeader() - Method in class com.norconex.committer.core.fs.impl.CsvColumn

getHeadersPrefix() - Method in class com.norconex.crawler.web.doc.operations.robot.impl.StandardRobotsMetaProviderConfig

getHeadersPrefix() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

Optional prefix prepended to captured HTTP response fields.

getHeight() - Method in class com.norconex.importer.handler.transformer.impl.ImageTransformerConfig.Crop

getHeight() - Method in class com.norconex.importer.handler.transformer.impl.ImageTransformerConfig.Scale

getHost() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthConfig

The host for the current authentication scope.

getHost() - Method in class com.norconex.crawler.web.fetch.impl.webdriver.HttpSnifferConfig

The host name passed to the browser pointing to the sniffer proxy.

getHttpBackoffInitialIntervalMillis() - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig

Optional exponential backoff initial interval in milliseconds.

getHttpBackoffMaxElapsedTimeMillis() - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig

Optional exponential backoff maximum elapsed time in milliseconds.

getHttpBackoffMaxIntervalMillis() - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig

Optional exponential backoff maximum interval in milliseconds.

getHttpClient() - Method in class com.norconex.crawler.fs.fetch.impl.cmis.CmisAtomSession

getHttpClient() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcher

getHttpConnectTimeoutMillis() - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig

Optional HTTP connect timeout in milliseconds applied to Google API requests.

getHttpMaxRetries() - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig

Optional HTTP retry count for Google API requests.

getHttpMethods() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

Gets the list of HTTP methods to be accepted by this fetcher.

getHttpReadTimeoutMillis() - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig

Optional HTTP read timeout in milliseconds applied to Google API requests.

getHttpReasonPhrase() - Method in class com.norconex.crawler.web.ledger.WebCrawlerEntry

HTTP reason phrase from the last fetch response.

getHttpSniffer() - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig

Optionally setup an HTTP proxy that allows to set and capture HTTP headers.

getHttpStatusCode() - Method in class com.norconex.crawler.web.ledger.WebCrawlerEntry

HTTP status code from the last fetch response.

getId() - Method in class com.norconex.crawler.core.cluster.pipeline.BaseStep

getId() - Method in class com.norconex.crawler.core.cluster.pipeline.Pipeline

getId() - Method in interface com.norconex.crawler.core.cluster.pipeline.Step

getId() - Method in class com.norconex.crawler.core.context.CrawlerContext

Gets the crawler id.

getId() - Method in class com.norconex.crawler.core.CrawlerConfig

The crawler unique identifier.

getIdleTimeout() - Method in class com.norconex.crawler.core.CrawlerConfig

The maximum amount of time to wait before shutting down an idle crawler.

getImage() - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImage

getImage(String) - Method in class com.norconex.crawler.web.doc.operations.image.impl.ImageCache

Returns the cached image for the given URL, or null if absent or if the cached entry cannot be decoded.

getImageCacheSize() - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig

Maximum number of images to cache in memory for faster processing.

getImageFormat() - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig

Target format of stored image.

getImageFormat() - Method in class com.norconex.crawler.web.fetch.util.DocImageHandlerConfig

getImageMagickPath() - Method in class com.norconex.importer.handler.parser.impl.OcrConfig

getImplicitlyWait() - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig

Web driver max wait time for an element to appear.

getImporter() - Method in class com.norconex.crawler.core.context.CrawlerContext

getImporterConfig() - Method in class com.norconex.crawler.core.CrawlerConfig

The Importer module configuration.

getImporterPipeline() - Method in class com.norconex.crawler.core.doc.pipelines.CrawlerDocPipelines

getImporterResponse() - Method in class com.norconex.crawler.core.doc.pipelines.importer.ImporterPipelineContext

getIndent() - Method in class com.norconex.committer.core.fs.impl.JsonFileCommitterConfig

getIndent() - Method in class com.norconex.committer.core.fs.impl.XmlFileCommitterConfig

getIndexName() - Method in class com.norconex.committer.azurecognitivesearch.AzureSearchCommitterConfig

The target index name.

getIndexName() - Method in class com.norconex.committer.elasticsearch.ElasticsearchCommitterConfig

The Elasticsearch index name.

getInitializedQueue() - Method in class com.norconex.committer.core.batch.AbstractBatchCommitter

getInitialLoadMode() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.JdbcHazelcastConfigurer

Hazelcast map-store initial load mode.

getInputStream() - Method in class com.norconex.importer.doc.Doc

getInputStream() - Method in class com.norconex.importer.ImporterRequest

getInstanceName() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastClusterConnectorConfig

Unique name for the Hazelcast instance.

getInteger(String) - Method in class com.norconex.crawler.core.session.CrawlerAttributes

Gets an attribute as an integer.

getJdbcDriver() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.JdbcHazelcastConfigurer

JDBC driver class name.

getJdbcPassword() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.JdbcHazelcastConfigurer

JDBC password.

getJdbcUrl() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.JdbcHazelcastConfigurer

JDBC URL for the data source.

getJdbcUsername() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.JdbcHazelcastConfigurer

JDBC username.

getJetEnabled() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.JdbcHazelcastConfigurer

Whether Hazelcast Jet engine should be enabled.

getJson() - Method in class com.norconex.crawler.core.cluster.SerializedCache.SerializedEntry

getJsonFieldsPattern() - Method in class com.norconex.committer.elasticsearch.ElasticsearchCommitterConfig

The regular expression matching fields that contains a JSON object for its value (as opposed to a regular string).

getKeepReferencedLinks() - Method in class com.norconex.crawler.web.WebCrawlerConfig

Gets what type of referenced links to keep, if any.

getKerberosConfig() - Method in class com.norconex.crawler.fs.fetch.impl.hdfs.HdfsFetcherConfig

Kerberos/SPNEGO configuration.

getKerberosConfig() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthConfig

Kerberos/SPNEGO configuration.

getKey() - Method in class com.norconex.crawler.core.cluster.SerializedCache.SerializedEntry

getKeyStoreFile() - Method in class com.norconex.crawler.fs.fetch.impl.webdav.WebDavFetcherConfig

getKeyStorePass() - Method in class com.norconex.crawler.fs.fetch.impl.webdav.WebDavFetcherConfig

getKeyStorePassKey() - Method in class com.norconex.crawler.fs.fetch.impl.webdav.WebDavFetcherConfig

getKeyStoreType() - Method in class com.norconex.crawler.fs.fetch.impl.webdav.WebDavFetcherConfig

getKeytabPath() - Method in class com.norconex.crawler.fs.fetch.impl.hdfs.KerberosConfig

Path to a keytab file containing the principal's key.

getKeytabPath() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.KerberosConfig

Path to a keytab file containing the principal's key.

getKnownHosts() - Method in class com.norconex.crawler.fs.fetch.impl.sftp.SftpFetcherConfig

getKrb5ConfigPath() - Method in class com.norconex.crawler.fs.fetch.impl.hdfs.KerberosConfig

Path to the Kerberos configuration file (krb5.conf).

getKrb5ConfigPath() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.KerberosConfig

Path to the Kerberos configuration file (krb5.conf).

getLabel() - Method in class com.norconex.importer.handler.BaseLabelableConfig

getLabel() - Method in class com.norconex.importer.handler.condition.ConditionalDocHandler

getLabel() - Method in class com.norconex.importer.handler.condition.ConditionGroup

getLabel() - Method in interface com.norconex.importer.handler.Labelable

Gets an optional user-supplied label.

getLanguage() - Method in class com.norconex.importer.handler.parser.impl.OcrConfig

getLanguages() - Method in class com.norconex.importer.handler.transformer.impl.LanguageTransformerConfig

The language candidates for language detection.

getLastFetchResponse() - Method in class com.norconex.crawler.core.fetch.AggregatedFetchResponse

getLastModified() - Method in class com.norconex.crawler.core.ledger.CrawlerEntry

getLastModified() - Method in class com.norconex.crawler.web.doc.operations.sitemap.SitemapRecord

getLastStep() - Method in class com.norconex.crawler.core.cluster.pipeline.Pipeline

getLastStepId() - Method in class com.norconex.crawler.core.cluster.pipeline.PipelineResult

getLastUpdated() - Method in class com.norconex.crawler.core.session.CrawlerSession.State

getLatePageScript() - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcherConfig

Optional JavaScript code executed after all wait conditions have been satisfied.

getLatePageScript() - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig

Optional JavaScript code to be run after we are done waiting for a page.

getLinesToSkip() - Method in class com.norconex.importer.handler.splitter.impl.CsvSplitterConfig

The number of lines to skip before starting to parse lines.

getLinkExtractors() - Method in class com.norconex.crawler.web.WebCrawlerConfig

Gets link extractors.

getLinkSelectors() - Method in class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractorConfig

getLiveThreadCount() - Static method in class com.norconex.crawler.core.util.ThreadTracker

getLocalAddress() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

The local address, which may be useful when working with multiple network interfaces.

getLocale() - Method in class com.norconex.importer.handler.transformer.impl.CurrentDateTransformerConfig

The locale used for formatting.

getLocalNode() - Method in interface com.norconex.crawler.core.cluster.Cluster

getLocalNode() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastCluster

getLocalNode() - Method in class com.norconex.crawler.core.cluster.impl.memory.MemoryCluster

getLocalNode() - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCluster

getLocation() - Method in class com.norconex.crawler.web.doc.operations.sitemap.SitemapContext

getLocation() - Method in class com.norconex.crawler.web.doc.operations.sitemap.SitemapRecord

getLogFields() - Method in class com.norconex.importer.handler.transformer.impl.DebugTransformerConfig

getLoginModuleName() - Method in class com.norconex.crawler.fs.fetch.impl.hdfs.KerberosConfig

The JAAS login module name.

getLoginModuleName() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.KerberosConfig

The JAAS login module name.

getLogLevel() - Method in class com.norconex.committer.core.impl.LogCommitterConfig

getLogLevel() - Method in class com.norconex.importer.handler.transformer.impl.DebugTransformerConfig

getMapper() - Static method in class com.norconex.crawler.core.util.SerialUtil

Returns the shared ObjectMapper instance.

getMappings() - Method in class com.norconex.crawler.core.doc.operations.spoil.impl.GenericSpoiledReferenceStrategizerConfig

getMatch() - Method in class com.norconex.crawler.web.doc.operations.link.impl.RegexLinkExtractorConfig.ExtractionPattern

getMatch() - Method in class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizerConfig.NormalizationReplace

getMatcher() - Method in class com.norconex.crawler.web.doc.operations.recrawl.impl.GenericRecrawlableResolverConfig.MinFrequency

A matcher applied to either a document reference or content type, based on GenericRecrawlableResolverConfig.MinFrequency.getApplyTo().

getMaxBufferSize() - Method in class com.norconex.crawler.web.fetch.impl.webdriver.HttpSnifferConfig

Maximum byte size before a request/response content is considered too large.

getMaxConnectionIdleTime() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

Sets the period of time after which to evict idle connections from the connection pool.

getMaxConnectionInactiveTime() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

Sets the period of time a connection must be inactive to be checked in case it became stalled.

getMaxConnections() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

The maximum number of connections that can be created.

getMaxConnectionsPerHost() - Method in class com.norconex.crawler.fs.fetch.impl.webdav.WebDavFetcherConfig

getMaxConnectionsPerRoute() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

The maximum number of connections that can be used per route.

getMaxCrawlDuration() - Method in class com.norconex.crawler.core.CrawlerConfig

The maximum amount of time a crawler is allowed to run.

getMaxDepth() - Method in class com.norconex.crawler.core.CrawlerConfig

The maximum depth the crawler should go.

getMaxDocuments() - Method in class com.norconex.crawler.core.CrawlerConfig

The maximum number of documents that can be processed in a single crawler run before stopping.

getMaxEmbeddedDepth() - Method in class com.norconex.importer.handler.parser.impl.EmbeddedConfig

Maximum detph of embeded documents to extract.

getMaxFileSizeToOcr() - Method in class com.norconex.importer.handler.parser.impl.OcrConfig

getMaximum() - Method in class com.norconex.crawler.core.event.listeners.StopCrawlerOnMaxEventListenerConfig

The maximum number of events matching the event matcher on which we stop the crawler.

getMaxLength() - Method in class com.norconex.importer.handler.transformer.impl.TruncateTransformerConfig

getMaxMemoryInstance() - Method in class com.norconex.importer.ImporterConfig

The maximum number of bytes used for memory caching of a single documents being processed.

getMaxMemoryPool() - Method in class com.norconex.importer.ImporterConfig

The maximum number of bytes used for memory caching of data for all documents concurrently being processed.

getMaxPathLength() - Method in class com.norconex.importer.handler.transformer.impl.SaveDocumentTransformerConfig

getMaxPerFolder() - Method in class com.norconex.committer.core.batch.queue.impl.FsQueueConfig

The maximum number of files to be queued on disk in a given folders.

getMaxPoolSize() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.JdbcHazelcastConfigurer

Maximum JDBC connection pool size.

getMaxQueueBatchSize() - Method in class com.norconex.crawler.core.CrawlerConfig

The maximum number of references a node will read at once from the queue, to process locally.

getMaxReadSize() - Method in class com.norconex.importer.handler.condition.impl.ScriptConditionConfig

The maximum number of characters to read at once, used for filtering.

getMaxReadSize() - Method in class com.norconex.importer.handler.condition.impl.TextConditionConfig

The maximum number of characters to read at once, used for filtering.

getMaxReadSize() - Method in class com.norconex.importer.handler.transformer.impl.CollapseRepeatingTransformerConfig

getMaxReadSize() - Method in class com.norconex.importer.handler.transformer.impl.CountMatchesTransformerConfig

The maximum number of characters to read from content for tagging at once.

getMaxReadSize() - Method in class com.norconex.importer.handler.transformer.impl.LanguageTransformerConfig

getMaxReadSize() - Method in class com.norconex.importer.handler.transformer.impl.RegexTransformerConfig

getMaxReadSize() - Method in class com.norconex.importer.handler.transformer.impl.ReplaceTransformerConfig

getMaxReadSize() - Method in class com.norconex.importer.handler.transformer.impl.ScriptTransformerConfig

getMaxReadSize() - Method in class com.norconex.importer.handler.transformer.impl.StripAfterTransformerConfig

getMaxReadSize() - Method in class com.norconex.importer.handler.transformer.impl.StripBeforeTransformerConfig

getMaxReadSize() - Method in class com.norconex.importer.handler.transformer.impl.StripBetweenTransformerConfig

getMaxReadSize() - Method in class com.norconex.importer.handler.transformer.impl.TextBetweenTransformerConfig

getMaxReadSize() - Method in class com.norconex.importer.handler.transformer.impl.TitleGeneratorTransformerConfig

getMaxReadSize() - Method in class com.norconex.importer.handler.transformer.impl.UrlExtractorTransformerConfig

The maximum number of characters to read from content for tagging at once.

getMaxReadSize() - Method in interface com.norconex.importer.util.chunk.ChunkedTextSupport

getMaxRedirects() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

The maximum number of redirects to be followed.

getMaxRetries() - Method in class com.norconex.committer.core.batch.queue.impl.FsQueueConfig.OnCommitFailure

Maximum retries upon commit failures.

getMaxRetries() - Method in class com.norconex.crawler.core.fetch.MultiFetcher

getMaxSamples() - Method in class com.norconex.importer.handler.transformer.impl.FieldReportTransformerConfig

getMaxStreamCachePoolSize() - Method in class com.norconex.crawler.core.CrawlerConfig

Maximum number of bytes used for memory caching of all reusable streams combined, at any given time, for faster processing.

getMaxStreamCacheSize() - Method in class com.norconex.crawler.core.CrawlerConfig

Maximum number of bytes used for memory caching of a single reusable stream, for faster processing.

getMaxTotalConnections() - Method in class com.norconex.crawler.fs.fetch.impl.webdav.WebDavFetcherConfig

getMaxUrlLength() - Method in class com.norconex.crawler.web.doc.operations.link.impl.RegexLinkExtractorConfig

The maximum supported URL length.

getMaxURLLength() - Method in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractorConfig

The maximum supported URL length.

getMessage() - Method in class com.norconex.crawler.core.cluster.pipeline.Step.StepProgress

getMessage() - Method in class com.norconex.importer.handler.RejectConfig

getMetaChecksum() - Method in class com.norconex.crawler.core.ledger.CrawlerEntry

getMetadata() - Method in interface com.norconex.committer.core.CommitterRequest

Gets the metadata.

getMetadata() - Method in class com.norconex.committer.core.DeleteRequest

getMetadata() - Method in class com.norconex.committer.core.UpsertRequest

getMetadata() - Method in class com.norconex.crawler.web.doc.operations.link.Link

getMetadata() - Method in class com.norconex.importer.doc.Doc

getMetadata() - Method in class com.norconex.importer.ImporterRequest

getMetadataChecksummer() - Method in class com.norconex.crawler.core.CrawlerConfig

The metadata checksummer.

getMetadataFetchSupport() - Method in class com.norconex.crawler.core.CrawlerConfig

getMetadataFilters() - Method in class com.norconex.crawler.core.CrawlerConfig

Gets metadata filters.

getMetadataInputFormat() - Method in class com.norconex.importer.handler.transformer.impl.ExternalTransformerConfig

getMetadataMappings() - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig

getMetadataOutputFormat() - Method in class com.norconex.importer.handler.transformer.impl.ExternalTransformerConfig

getMethod() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthConfig

The authentication method.

getMethod() - Method in class com.norconex.crawler.web.fetch.WebFetchRequest

getMetrics() - Method in class com.norconex.crawler.core.context.CrawlerContext

getMinDimensions() - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig

Minimum pixel size for an image to be considered.

getMinFileSizeToOcr() - Method in class com.norconex.importer.handler.parser.impl.OcrConfig

getMinFrequencies() - Method in class com.norconex.crawler.web.doc.operations.recrawl.impl.GenericRecrawlableResolverConfig

Gets minimum frequencies.

getMinProgressLoggingInterval() - Method in class com.norconex.crawler.core.CrawlerConfig

Minimum amount of time to wait between each logging of crawling progress.

getModelPath() - Method in class com.norconex.importer.handler.parser.impl.SentimentConfig

getMultiValueJoinDelimiter() - Method in class com.norconex.committer.core.fs.impl.CsvFileCommitterConfig

String used as delimiter when joining multi-value fields.

getMultiValuesJoiner() - Method in class com.norconex.committer.neo4j.Neo4jCommitterConfig

One or more characters to join multi-value fields.

getMultiValuesJoiner() - Method in class com.norconex.committer.sql.SqlCommitterConfig

One or more characters to join multi-value fields.

getName() - Method in interface com.norconex.crawler.core.cluster.CacheMap

Gets the name of this cache.

getName() - Method in interface com.norconex.crawler.core.cluster.CacheQueue

Gets the name of this cache.

getName() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastMapAdapter

getName() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastQueueAdapter

getName() - Method in class com.norconex.crawler.core.cluster.impl.memory.InMemoryCacheMap

getName() - Method in class com.norconex.crawler.core.cluster.impl.memory.InMemoryCacheQueue

getName() - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheMap

getName() - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheQueue

getName() - Method in class com.norconex.importer.handler.condition.ConditionalDocHandler

getName() - Method in class com.norconex.importer.handler.condition.If

getName() - Method in class com.norconex.importer.handler.condition.IfNot

getName() - Method in class com.norconex.importer.handler.transformer.impl.Constant

getName(int) - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyPath

getNameCount() - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyPath

getNativeDocumentFormatPolicy() - Method in class com.norconex.crawler.fs.fetch.impl.googledrive.GoogleDriveFetcherConfig

Default export policy for Google-native document families when no explicit override is configured.

getNativeRetryBaseDelay() - Method in class com.norconex.crawler.fs.fetch.impl.m365graph.M365GraphFetcherConfig

Base delay for native retries when Retry-After is not provided.

getNativeRetryMaxRetries() - Method in class com.norconex.crawler.fs.fetch.impl.m365graph.M365GraphFetcherConfig

Maximum native retries for status codes listed in M365GraphFetcherConfig.nativeRetryStatusCodes.

getNativeRetryStatusCodes() - Method in class com.norconex.crawler.fs.fetch.impl.m365graph.M365GraphFetcherConfig

getNestedResponses() - Method in class com.norconex.importer.response.ImporterResponse

getNetworkInterface() - Method in class com.norconex.crawler.web.fetch.impl.webdriver.HttpSnifferConfig

Network interface address (IP) to be used by the sniffer proxy to listen for incoming connections.

getNodeContentProperty() - Method in class com.norconex.committer.neo4j.Neo4jCommitterConfig

Optional property name where to store the document content in Neo4j graph entries.

getNodeCount() - Method in interface com.norconex.crawler.core.cluster.Cluster

Returns the number of nodes in the cluster.

getNodeCount() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastCluster

getNodeCount() - Method in class com.norconex.crawler.core.cluster.impl.memory.MemoryCluster

getNodeCount() - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCluster

getNodeExpiryTimeout() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastClusterConnectorConfig

Maximum amount of time to wait before declaring a node as "expired" when running a crawler task across multiple nodes.

getNodeIdProperty() - Method in class com.norconex.committer.neo4j.Neo4jCommitterConfig

Optional property name where to store the document reference in Neo4j graph entries.

getNodeName() - Method in interface com.norconex.crawler.core.cluster.ClusterNode

getNodeName() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastClusterNode

getNodeNames() - Method in interface com.norconex.crawler.core.cluster.Cluster

Returns the names of all nodes in the cluster.

getNodeNames() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastCluster

getNodeNames() - Method in class com.norconex.crawler.core.cluster.impl.memory.MemoryCluster

getNodeNames() - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCluster

getNodes() - Method in class com.norconex.committer.elasticsearch.ElasticsearchCommitterConfig

Gets an unmodifiable list of Elasticsearch cluster node URLs.

getNoExtractBetweens() - Method in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractorConfig

Gets the patterns delimiting the portions of a document to be excluded from link extraction.

getNoExtractSelectors() - Method in class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractorConfig

getNoExtractSelectors() - Method in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractorConfig

Gets the selectors matching the portions of a document to be excluded from link extraction.

getNormalizations() - Method in class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizerConfig

getNotFoundStatusCodes() - Method in class com.norconex.crawler.fs.fetch.impl.box.BoxFetcherConfig

getNotFoundStatusCodes() - Method in class com.norconex.crawler.fs.fetch.impl.egnyte.EgnyteFetcherConfig

getNotFoundStatusCodes() - Method in class com.norconex.crawler.fs.fetch.impl.m365graph.M365GraphFetcherConfig

getNotFoundStatusCodes() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

Gets HTTP status codes to be considered as "Not found" state.

getNumber() - Method in class com.norconex.importer.handler.condition.impl.NumericValueMatcher

getNumThreads() - Method in class com.norconex.crawler.core.CrawlerConfig

The maximum number of threads a crawler can use.

getObjectByPathTemplate() - Method in class com.norconex.crawler.fs.fetch.impl.cmis.CmisAtomSession

getOcrConfig() - Method in class com.norconex.importer.handler.parser.impl.DefaultParserConfig

getOnCommitFailure() - Method in class com.norconex.committer.core.batch.queue.impl.FsQueueConfig

Establishes how to handle commit failures.

getOnMatch() - Method in class com.norconex.crawler.core.doc.operations.filter.impl.ExtensionReferenceFilter

getOnMatch() - Method in class com.norconex.crawler.core.doc.operations.filter.impl.ExtensionReferenceFilterConfig

getOnMatch() - Method in class com.norconex.crawler.core.doc.operations.filter.impl.GenericMetadataFilter

getOnMatch() - Method in class com.norconex.crawler.core.doc.operations.filter.impl.GenericMetadataFilterConfig

getOnMatch() - Method in class com.norconex.crawler.core.doc.operations.filter.impl.GenericReferenceFilter

getOnMatch() - Method in class com.norconex.crawler.core.doc.operations.filter.impl.GenericReferenceFilterConfig

getOnMatch() - Method in interface com.norconex.crawler.core.doc.operations.filter.OnMatchFilter

Gets the the on match action (exclude or include).

getOnMatch() - Method in class com.norconex.crawler.web.doc.operations.filter.impl.SegmentCountUrlFilter

getOnMatch() - Method in class com.norconex.crawler.web.doc.operations.filter.impl.SegmentCountUrlFilterConfig

Action to undertake when there is a match.

getOnMultiple() - Method in class com.norconex.crawler.core.event.listeners.StopCrawlerOnMaxEventListenerConfig

getOnSet() - Method in class com.norconex.crawler.core.doc.operations.checksum.BaseChecksummerConfig

The property setter to use when a value is set.

getOnSet() - Method in class com.norconex.importer.handler.transformer.impl.Constant

getOnSet() - Method in class com.norconex.importer.handler.transformer.impl.ConstantTransformerConfig

Default property setter when a constant does not specify one.

getOnSet() - Method in class com.norconex.importer.handler.transformer.impl.CopyOperation

getOnSet() - Method in class com.norconex.importer.handler.transformer.impl.CopyTransformerConfig

Default property setter when an operation does not specify one.

getOnSet() - Method in class com.norconex.importer.handler.transformer.impl.CountMatchesTransformerConfig

Gets the property setter to use when a value is set.

getOnSet() - Method in class com.norconex.importer.handler.transformer.impl.CurrentDateTransformerConfig

The property setter to use when a value is set.

getOnSet() - Method in class com.norconex.importer.handler.transformer.impl.DateFormatTransformerConfig

The property setter to use when a value is set.

getOnSet() - Method in class com.norconex.importer.handler.transformer.impl.DocumentLengthTransformerConfig

Gets the property setter to use when a value is set.

getOnSet() - Method in class com.norconex.importer.handler.transformer.impl.DomOperation

The gets the property setter to use when a value is set.

getOnSet() - Method in class com.norconex.importer.handler.transformer.impl.ExternalTransformerConfig

Gets the property setter to use when a metadata value is set.

getOnSet() - Method in class com.norconex.importer.handler.transformer.impl.HierarchyOperation

Gets the property setter to use when a value is set.

getOnSet() - Method in class com.norconex.importer.handler.transformer.impl.RenameOperation

getOnSet() - Method in class com.norconex.importer.handler.transformer.impl.ReplaceOperation

getOnSet() - Method in class com.norconex.importer.handler.transformer.impl.SplitOperation

The property setter to use when a value is set.

getOnSet() - Method in class com.norconex.importer.handler.transformer.impl.TextBetweenOperation

The property setter to use when a value is set.

getOnSet() - Method in class com.norconex.importer.handler.transformer.impl.TitleGeneratorTransformerConfig

The property setter to use when a value is set.

getOnSet() - Method in class com.norconex.importer.handler.transformer.impl.TruncateTransformerConfig

The property setter to use when a value is set.

getOnSet() - Method in class com.norconex.importer.handler.transformer.impl.UrlExtractorTransformerConfig

The property setter to use when a value is set.

getOnSet() - Method in class com.norconex.importer.handler.transformer.impl.UuidTransformerConfig

The property setter to use when a value is set.

getOperations() - Method in class com.norconex.importer.handler.transformer.impl.CopyTransformerConfig

getOperations() - Method in class com.norconex.importer.handler.transformer.impl.DomTransformerConfig

getOperations() - Method in class com.norconex.importer.handler.transformer.impl.HierarchyTransformerConfig

getOperations() - Method in class com.norconex.importer.handler.transformer.impl.MergeTransformerConfig

getOperations() - Method in class com.norconex.importer.handler.transformer.impl.RenameTransformerConfig

getOperations() - Method in class com.norconex.importer.handler.transformer.impl.ReplaceTransformerConfig

getOperations() - Method in class com.norconex.importer.handler.transformer.impl.SplitTransformerConfig

getOperations() - Method in class com.norconex.importer.handler.transformer.impl.StripBetweenTransformerConfig

getOperations() - Method in class com.norconex.importer.handler.transformer.impl.TextBetweenTransformerConfig

getOperator() - Method in class com.norconex.importer.handler.condition.impl.DateValueMatcher

getOperator() - Method in class com.norconex.importer.handler.condition.impl.NumericValueMatcher

getOptionalParameters() - Method in class com.norconex.committer.neo4j.Neo4jCommitterConfig

getOrDefault(String, T) - Method in interface com.norconex.crawler.core.cluster.CacheMap

getOrDefault(String, T) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastMapAdapter

getOrDefault(String, T) - Method in class com.norconex.crawler.core.cluster.impl.memory.InMemoryCacheMap

getOrDefault(String, T) - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheMap

getOriginalSize() - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImage

getOrOpenFileSystem(URI, Map<String, ?>) - Method in class com.norconex.crawler.fs.fetch.impl.AbstractNioFetcher

Gets the FileSystem for the given URI's host and port, opening and caching a new one on first use.

getOrphansStrategy() - Method in class com.norconex.crawler.core.CrawlerConfig

The strategy to adopt when there are orphans.

getOutputDir() - Method in class com.norconex.crawler.web.event.listeners.UrlStatusCrawlerEventListenerConfig

The local directory where this listener report will be written.

getPageContentTypePattern() - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig

Optional regex to overwrite default matching of HTML pages.

getPageLoadTimeout() - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcherConfig

Maximum time to wait for the page load event.

getPageLoadTimeout() - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig

Web driver max wait time for a page to load.

getPageSegMode() - Method in class com.norconex.importer.handler.parser.impl.OcrConfig

getPageSeparator() - Method in class com.norconex.importer.handler.parser.impl.OcrConfig

getPageSplitSize() - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreClusterConnectorConfig

The page split size in bytes.

getParent() - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyPath

getParentReferences() - Method in class com.norconex.importer.doc.Doc

getParentResponse() - Method in class com.norconex.importer.response.ImporterResponse

getParser() - Method in class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractorConfig

The parser to use when creating the DOM-tree.

getParser() - Method in class com.norconex.importer.handler.condition.impl.DomConditionConfig

Gets the parser to use when creating the DOM-tree.

getParser() - Method in class com.norconex.importer.handler.splitter.impl.DomSplitterConfig

The type of parser to use when creating the DOM-tree.

getParser() - Method in class com.norconex.importer.handler.transformer.impl.DomTransformerConfig

The type of parser to use when creating the DOM-tree.

getParseState() - Method in class com.norconex.importer.ImporterEvent

Gets the document parse state (never null).

getPartitions() - Method in class com.norconex.committer.apachekafka.ApacheKafkaCommitterConfig

The number of partitions for the new topic.

getPath() - Method in interface com.norconex.crawler.web.doc.operations.robot.RobotsTxtFilter

getPath() - Method in class com.norconex.importer.handler.splitter.impl.XmlStreamSplitterConfig

getPath(String, String...) - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyFileSystem

getPathMatcher(String) - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyFileSystem

getPaths() - Method in class com.norconex.crawler.web.doc.operations.sitemap.impl.GenericSitemapLocatorConfig

Gets the URL paths, relative to the URL root, from which to try locate and resolve sitemaps.

getPathToField() - Method in class com.norconex.importer.handler.transformer.impl.SaveDocumentTransformerConfig

getPattern() - Method in class com.norconex.crawler.web.doc.operations.delay.impl.DelayReferencePattern

getPatterns() - Method in class com.norconex.crawler.web.doc.operations.link.impl.RegexLinkExtractorConfig

getPatterns() - Method in class com.norconex.importer.handler.transformer.impl.RegexTransformerConfig

Gets the patterns used to extract matching field names/values.

getPeakThreadCount() - Static method in class com.norconex.crawler.core.util.ThreadTracker

getPipelineId() - Method in class com.norconex.crawler.core.cluster.pipeline.PipelineResult

getPipelineId() - Method in class com.norconex.crawler.core.cluster.pipeline.StepRecord

getPipelineManager() - Method in interface com.norconex.crawler.core.cluster.Cluster

getPipelineManager() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastCluster

getPipelineManager() - Method in class com.norconex.crawler.core.cluster.impl.memory.MemoryCluster

getPipelineManager() - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCluster

getPipelineProgress(String) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.pipeline.HazelcastPipelineManager

getPipelineProgress(String) - Method in class com.norconex.crawler.core.cluster.impl.memory.LocalPipelineManager

getPipelineProgress(String) - Method in interface com.norconex.crawler.core.cluster.pipeline.PipelineManager

A snapshot of pipeline progress made so far.

getPipelineStepCache() - Method in interface com.norconex.crawler.core.cluster.CacheManager

Gets the pipeline step cache for storing current pipeline steps.

getPipelineStepCache() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastCacheManager

getPipelineStepCache() - Method in class com.norconex.crawler.core.cluster.impl.memory.MemoryCacheManager

getPipelineStepCache() - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheManager

getPipelineWorkerStatusCache() - Method in interface com.norconex.crawler.core.cluster.CacheManager

Gets the pipeline worker status cache for storing worker statuses.

getPipelineWorkerStatusCache() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastCacheManager

getPipelineWorkerStatusCache() - Method in class com.norconex.crawler.core.cluster.impl.memory.MemoryCacheManager

getPipelineWorkerStatusCache() - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheManager

getPolymorphicTypes() - Method in class com.norconex.committer.amazoncloudsearch.spi.AmazonCloudSearchCommitterPtProvider

getPolymorphicTypes() - Method in class com.norconex.committer.apachekafka.spi.ApacheKafkaCommitterPtProvider

getPolymorphicTypes() - Method in class com.norconex.committer.azurecognitivesearch.spi.AzureSearchCommitterPtProvider

getPolymorphicTypes() - Method in class com.norconex.committer.core.spi.CommitterCorePtProvider

getPolymorphicTypes() - Method in class com.norconex.committer.elasticsearch.spi.ElasticsearchCommitterPtProvider

getPolymorphicTypes() - Method in class com.norconex.committer.googlecloudsearch.spi.GoogleCloudSearchCommitterPtProvider

getPolymorphicTypes() - Method in class com.norconex.committer.idol.spi.IdolCommitterPtProvider

getPolymorphicTypes() - Method in class com.norconex.committer.neo4j.spi.Neo4jCommitterPtProvider

getPolymorphicTypes() - Method in class com.norconex.committer.solr.spi.SolrCommitterPtProvider

getPolymorphicTypes() - Method in class com.norconex.committer.sql.spi.SqlCommitterPtProvider

getPolymorphicTypes() - Method in class com.norconex.crawler.web.spi.CrawlerWebPtProvider

getPolymorphicTypes() - Method in class com.norconex.importer.spi.ImporterPtProvider

getPort() - Method in class com.norconex.crawler.core.cluster.admin.ClusterAdminServer

getPort() - Method in class com.norconex.crawler.web.fetch.impl.webdriver.HttpSnifferConfig

The host port passed to the browser pointing to the sniffer proxy.

getPostImportConsumers() - Method in class com.norconex.crawler.core.CrawlerConfig

Gets post-import consumers.

getPostImportLinks() - Method in class com.norconex.crawler.web.WebCrawlerConfig

Gets a field matcher used to identify post-import metadata fields holding URLs to consider for crawling.

getPreferredAuthentications() - Method in class com.norconex.crawler.fs.fetch.impl.sftp.SftpFetcherConfig

getPrefix() - Method in class com.norconex.importer.handler.transformer.impl.DebugTransformerConfig

The prefix to print before the actual log message.

getPreImportConsumers() - Method in class com.norconex.crawler.core.CrawlerConfig

Gets pre-import consumers.

getPreserveInterwordSpacing() - Method in class com.norconex.importer.handler.parser.impl.OcrConfig

getPreviousCrawlEntry() - Method in class com.norconex.crawler.core.doc.CrawlerDocContext

getPrimaryKey() - Method in class com.norconex.committer.sql.SqlCommitterConfig

The name of the table primary key field where the document reference will be stored, unless it is already set by a field of the same name in the source document.

getPrincipal() - Method in class com.norconex.crawler.fs.fetch.impl.hdfs.KerberosConfig

The Kerberos principal name used for login (e.g.

getPrincipal() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.KerberosConfig

The Kerberos principal name used for login (e.g., user@REALM).

getPrincipalType() - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.AclMapping

Type of principal the field value represents.

getPrivateKey() - Method in class com.norconex.crawler.fs.fetch.impl.googledrive.GoogleDriveFetcherConfig

PEM private key content or secure key reference.

getProcessedAt() - Method in class com.norconex.crawler.core.ledger.CrawlerEntry

getProcessedCount() - Method in class com.norconex.crawler.core.ledger.CrawlerEntryLedger

getProcessedCount() - Method in class com.norconex.crawler.core.metrics.CrawlerMetricsImpl

getProcessedCount() - Method in interface com.norconex.crawler.core.metrics.CrawlerMetricsMXBean

getProcessingAt() - Method in class com.norconex.crawler.core.ledger.CrawlerEntry

getProcessingCount() - Method in class com.norconex.crawler.core.ledger.CrawlerEntryLedger

getProcessingCount() - Method in class com.norconex.crawler.core.metrics.CrawlerMetricsImpl

getProcessingCount() - Method in interface com.norconex.crawler.core.metrics.CrawlerMetricsMXBean

getProcessingOutcome() - Method in class com.norconex.crawler.core.fetch.AggregatedFetchResponse

getProcessingOutcome() - Method in interface com.norconex.crawler.core.fetch.FetchResponse

getProcessingOutcome() - Method in class com.norconex.crawler.core.ledger.CrawlerEntry

getProcessingOutcome() - Method in class com.norconex.crawler.fs.fetch.impl.GenericFileFetchResponse

getProcessingOutcome() - Method in class com.norconex.crawler.fs.fetch.impl.GenericFolderPathsFetchResponse

getProcessingOutcome() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetchResponse

getProcessingStatus() - Method in class com.norconex.crawler.core.ledger.CrawlerEntry

getProcessingStatus(String) - Method in class com.norconex.crawler.core.ledger.CrawlerEntryLedger

Gets a reference processing status.

getProgress() - Method in interface com.norconex.crawler.core.cluster.pipeline.Step

Optional method returning the current progress of this step.

getProgress() - Method in class com.norconex.crawler.core.cluster.pipeline.Step.StepProgress

getProgress() - Method in class com.norconex.crawler.core.cmd.crawl.pipeline.process.CrawlerProcessStep

getProperties() - Method in class com.norconex.committer.sql.SqlCommitterConfig

getProxyDomain() - Method in class com.norconex.crawler.fs.fetch.impl.webdav.WebDavFetcherConfig

getProxySettings() - Method in class com.norconex.committer.amazoncloudsearch.AmazonCloudSearchCommitterConfig

getProxySettings() - Method in class com.norconex.committer.azurecognitivesearch.AzureSearchCommitterConfig

Gets the proxy settings.

getProxySettings() - Method in class com.norconex.crawler.fs.fetch.impl.ftp.FtpFetcherConfig

getProxySettings() - Method in class com.norconex.crawler.fs.fetch.impl.webdav.WebDavFetcherConfig

getProxySettings() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

getProxySettings() - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcherConfig

Proxy settings used when launching the browser.

getQueryTemplate() - Method in class com.norconex.crawler.fs.fetch.impl.cmis.CmisAtomSession

getQueue() - Method in class com.norconex.committer.core.batch.BaseBatchCommitterConfig

getQueueCount() - Method in class com.norconex.crawler.core.ledger.CrawlerEntryLedger

getQueuedAt() - Method in class com.norconex.crawler.core.ledger.CrawlerEntry

Gets the queued date.

getQueuedCount() - Method in class com.norconex.crawler.core.metrics.CrawlerMetricsImpl

getQueuedCount() - Method in interface com.norconex.crawler.core.metrics.CrawlerMetricsMXBean

getQueuedEntryCount() - Method in class com.norconex.crawler.core.ledger.CrawlerEntryLedger

Returns the number of entries tracked as ProcessingStatus.QUEUED in the current ledger.

getQueuePipeline() - Method in class com.norconex.crawler.core.doc.pipelines.CrawlerDocPipelines

getQuote() - Method in class com.norconex.committer.core.fs.impl.CsvFileCommitterConfig

Quote character to use.

getQuoteCharacter() - Method in class com.norconex.importer.handler.splitter.impl.CsvSplitterConfig

The value's surrounding quotes character.

getRealm() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthConfig

The realm name for the current authentication scope.

getReasonPhrase() - Method in class com.norconex.crawler.core.fetch.AggregatedFetchResponse

getReasonPhrase() - Method in interface com.norconex.crawler.core.fetch.FetchResponse

getReasonPhrase() - Method in class com.norconex.crawler.fs.fetch.impl.GenericFileFetchResponse

getReasonPhrase() - Method in class com.norconex.crawler.fs.fetch.impl.GenericFolderPathsFetchResponse

getReasonPhrase() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetchResponse

getRecentDateFormat() - Method in class com.norconex.crawler.fs.fetch.impl.ftp.FtpFetcherConfig

getRecrawlableResolver() - Method in class com.norconex.crawler.web.WebCrawlerConfig

The resolver that indicates whether a given URL is ready to be crawled by a new crawl session.

getRedirectTarget() - Method in class com.norconex.crawler.web.fetch.AggregatedWebFetchResponse

getRedirectTarget() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetchResponse

getRedirectTarget() - Method in interface com.norconex.crawler.web.fetch.WebFetchResponse

getRedirectTarget() - Method in class com.norconex.crawler.web.ledger.WebCrawlerEntry

getRedirectTarget(HttpContext) - Static method in class com.norconex.crawler.web.fetch.util.ApacheRedirectCaptureStrategy

getRedirectTrail() - Method in class com.norconex.crawler.web.ledger.WebCrawlerEntry

Gets the trail of URLs that were redirected up to this one.

getRedirectUrlProvider() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

The redirect URL provider.

getReference() - Method in interface com.norconex.committer.core.CommitterRequest

Gets the document reference.

getReference() - Method in class com.norconex.committer.core.DeleteRequest

getReference() - Method in class com.norconex.committer.core.UpsertRequest

getReference() - Method in class com.norconex.crawler.core.doc.CrawlerDocContext

getReference() - Method in class com.norconex.crawler.core.ledger.CrawlerEntry

getReference() - Method in class com.norconex.importer.doc.Doc

getReference() - Method in class com.norconex.importer.ImporterRequest

getReference() - Method in class com.norconex.importer.response.ImporterResponse

getReferenceColumn() - Method in class com.norconex.importer.handler.splitter.impl.CsvSplitterConfig

The column containing the unique document reference.

getReferencedUrls() - Method in class com.norconex.crawler.web.ledger.WebCrawlerEntry

Gets URLs referenced by this one.

getReferenceFilters() - Method in class com.norconex.crawler.core.CrawlerConfig

Gets reference filters

getReferenceFilters() - Method in class com.norconex.crawler.core.fetch.BaseFetcherConfig

Gets reference filters

getReferencePagePrefix() - Method in class com.norconex.importer.handler.splitter.impl.PdfPageSplitterConfig

getReferenceTrail() - Method in class com.norconex.crawler.core.ledger.CrawlerEntry

Gets original references before normalization, redirect, etc.

getReferrer() - Method in class com.norconex.crawler.web.doc.operations.link.Link

getReferrerLinkMetadata() - Method in class com.norconex.crawler.web.ledger.WebCrawlerEntry

getReferrerReference() - Method in class com.norconex.crawler.web.ledger.WebCrawlerEntry

getRegion() - Method in class com.norconex.crawler.fs.fetch.impl.s3.S3FetcherConfig

The AWS region the bucket lives in (e.g.

getRegistrationId() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.event.CacheEntryChangeListenerAdapter

getRejectCause() - Method in class com.norconex.importer.response.ImporterResponse

getRemoteURL() - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig

URL of a remote WebDriver cluster.

getRemoveCount() - Method in class com.norconex.committer.core.impl.LogCommitter

getReplace() - Method in class com.norconex.crawler.web.doc.operations.link.impl.RegexLinkExtractorConfig.ExtractionPattern

getReplacements() - Method in class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizerConfig

getReplicationFactor() - Method in class com.norconex.committer.apachekafka.ApacheKafkaCommitterConfig

Gets the replication factor for the new topic.

getRepoId() - Method in class com.norconex.crawler.fs.fetch.impl.cmis.CmisAtomSession

getRepoName() - Method in class com.norconex.crawler.fs.fetch.impl.cmis.CmisAtomSession

getRepositoryId() - Method in class com.norconex.crawler.fs.fetch.impl.cmis.CmisFetcherConfig

The CMIS repository ID.

getRequest() - Method in class com.norconex.committer.core.CommitterEvent

getRequestCount() - Method in class com.norconex.committer.core.impl.MemoryCommitter

getRequestHeader(String) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

Gets the HTTP request header value matching the given name, previously set with HttpClientFetcherConfig.setRequestHeader(String, String).

getRequestHeaderNames() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

Gets all HTTP request header names for headers previously set with HttpClientFetcherConfig.setRequestHeader(String, String).

getRequestHeaders() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

Headers to send with every HTTP request.

getRequestHeaders() - Method in class com.norconex.crawler.web.fetch.impl.webdriver.HttpSnifferConfig

Gets the request headers to add to every HTTP request.

getRequestMode() - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig

The priority/consistency mode sent with indexing and delete requests.

getResize() - Method in class com.norconex.importer.handler.parser.impl.OcrConfig

getResolvedDirectory() - Method in class com.norconex.committer.core.fs.AbstractFsCommitter

The directly from configuration, else, from the committer context working directory.

getResponseProcessors() - Method in class com.norconex.importer.ImporterConfig

getResponseTimeout() - Method in class com.norconex.crawler.web.fetch.impl.webdriver.HttpSnifferConfig

Maximum wait time for the target host to respond.

getRestrictions() - Method in class com.norconex.committer.core.BaseCommitterConfig

Gets all restrictions

getRestrictions() - Method in class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractorConfig

Gets all restrictions

getRestrictions() - Method in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractorConfig

Gets all restrictions

getRestrictions() - Method in class com.norconex.crawler.web.doc.operations.link.impl.RegexLinkExtractorConfig

Gets all restrictions

getRestrictions() - Method in class com.norconex.crawler.web.doc.operations.link.impl.TikaLinkExtractorConfig

Gets all restrictions

getRestrictions() - Method in class com.norconex.crawler.web.doc.operations.link.impl.XmlFeedLinkExtractorConfig

Gets all restrictions

getRetryDelay() - Method in class com.norconex.committer.core.batch.queue.impl.FsQueueConfig.OnCommitFailure

Delay in milliseconds between retries.

getRetryDelay() - Method in class com.norconex.crawler.core.fetch.MultiFetcher

getRobotsMeta() - Method in class com.norconex.crawler.web.doc.pipelines.importer.WebImporterPipelineContext

getRobotsMeta(Reader, String, ContentType, Properties) - Method in class com.norconex.crawler.web.doc.operations.robot.impl.StandardRobotsMetaProvider

getRobotsMeta(Reader, String, ContentType, Properties) - Method in interface com.norconex.crawler.web.doc.operations.robot.RobotsMetaProvider

Extracts Robots meta information for a page, if any.

getRobotsMetaProvider() - Method in class com.norconex.crawler.web.WebCrawlerConfig

The provider of robots metadata rules for a page (if applicable).

getRobotsTxt(Fetcher, String) - Method in class com.norconex.crawler.web.doc.operations.robot.impl.StandardRobotsTxtProvider

getRobotsTxt(Fetcher, String) - Method in interface com.norconex.crawler.web.doc.operations.robot.RobotsTxtProvider

Gets robots.txt rules.

getRobotsTxtProvider() - Method in class com.norconex.crawler.web.WebCrawlerConfig

The provider of robots.txt rules for a site (if applicable).

getRoot() - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyPath

getRootDirectories() - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyFileSystem

getRotation() - Method in class com.norconex.importer.handler.transformer.impl.ImageTransformerConfig

getRunCoordinator() - Method in class com.norconex.crawler.core.session.CrawlerSession

Coordinates task deduplication across session and run scopes.

getRunId() - Method in class com.norconex.crawler.core.cluster.pipeline.StepRecord

getSasToken() - Method in class com.norconex.crawler.fs.fetch.impl.adlsgen2.AdlsGen2FetcherConfig

Optional SAS token used instead of shared-key credentials.

getSasToken() - Method in class com.norconex.crawler.fs.fetch.impl.azureblob.AzureBlobFetcherConfig

Optional SAS token used instead of shared-key credentials.

getSaveDir() - Method in class com.norconex.importer.handler.transformer.impl.SaveDocumentTransformerConfig

getScale() - Method in class com.norconex.importer.handler.transformer.impl.ImageTransformerConfig

getScaleDimensions() - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig

Target pixel size the featured image should be scaled to.

getScaleQuality() - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig

Desired scaling quality.

getScalrMethod() - Method in enum class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig.Quality

getSchedules() - Method in class com.norconex.crawler.web.doc.operations.delay.impl.GenericDelayResolverConfig

getSchemes() - Method in class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractorConfig

Gets the schemes to be extracted.

getSchemes() - Method in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractorConfig

Gets the schemes to be extracted.

getScope() - Method in class com.norconex.crawler.web.doc.operations.delay.impl.BaseDelayResolverConfig

Gets the delay scope.

getScreenshotHandler() - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcherConfig

When configured, takes a screenshot of each fetched page and stores it according to the handler's configuration (document metadata field or local directory).

getScreenshotHandler() - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig

When configured, takes screenshots of each web pages.

getScript() - Method in class com.norconex.importer.handler.condition.impl.ScriptConditionConfig

getScript() - Method in class com.norconex.importer.handler.ScriptRunner

getScript() - Method in class com.norconex.importer.handler.transformer.impl.ScriptTransformerConfig

getScriptPath() - Method in class com.norconex.importer.handler.splitter.impl.TranslatorSplitterConfig

Moses script path.

getScriptRunner() - Method in class com.norconex.importer.handler.transformer.impl.ScriptTransformer

getScriptTimeout() - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig

Web driver max wait time for a scripts to execute.

getSecretKey() - Method in class com.norconex.committer.amazoncloudsearch.AmazonCloudSearchCommitterConfig

The CloudSearch secret key.

getSecretKeyPath() - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig

Path to the Google service account JSON key file, with access to the Cloud Search indexing API.

getSecurityMode() - Method in class com.norconex.crawler.fs.fetch.impl.ftp.FtpFetcherConfig

getSelector() - Method in class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractorConfig.LinkSelector

getSelector() - Method in class com.norconex.importer.handler.condition.impl.DomConditionConfig

getSelector() - Method in class com.norconex.importer.handler.splitter.impl.DomSplitterConfig

The CSS-like selector (see class documentation) identifying which elements to split.

getSelector() - Method in class com.norconex.importer.handler.transformer.impl.DomOperation

getSentimentConfig() - Method in class com.norconex.importer.handler.parser.impl.DefaultParserConfig

getSeparator() - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyFileSystem

getSeparator() - Method in class com.norconex.crawler.web.doc.operations.filter.impl.SegmentCountUrlFilterConfig

Segment separator.

getSeparator() - Method in class com.norconex.importer.handler.transformer.impl.SplitOperation

getSeparatorCharacter() - Method in class com.norconex.importer.handler.splitter.impl.CsvSplitterConfig

The value-separator character.

getSerialized() - Method in class com.norconex.crawler.core.cluster.SerializedRecord

getServerLanguageCode() - Method in class com.norconex.crawler.fs.fetch.impl.ftp.FtpFetcherConfig

getServiceEndpoint() - Method in class com.norconex.committer.amazoncloudsearch.AmazonCloudSearchCommitterConfig

The AWS service endpoint.

getServicePrincipalName() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.KerberosConfig

The Kerberos service principal name (SPN) for the target service.

getServiceUrl() - Method in class com.norconex.importer.handler.parser.impl.GrobidConfig

getSessionAttributes() - Method in class com.norconex.crawler.core.session.CrawlerSession

getSessionAttributes() - Method in class com.norconex.crawler.core.session.CrawlerStateStore

Returns the session-scoped attribute store backed by the session cache.

getShortMonthNames() - Method in class com.norconex.crawler.fs.fetch.impl.ftp.FtpFetcherConfig

getSigningRegion() - Method in class com.norconex.committer.amazoncloudsearch.AmazonCloudSearchCommitterConfig

The the AWS signing region.

getSingleValueSeparator() - Method in class com.norconex.importer.handler.transformer.impl.MergeOperation

getSitemapChangeFreq() - Method in class com.norconex.crawler.web.ledger.WebCrawlerEntry

The document change frequency according to sitemap.

getSitemapLastMod() - Method in class com.norconex.crawler.web.ledger.WebCrawlerEntry

The document last modified date according to sitemap.

getSitemapLocations() - Method in class com.norconex.crawler.web.doc.operations.robot.RobotsTxt

getSitemapLocator() - Method in class com.norconex.crawler.web.WebCrawlerConfig

The locator of sitemaps (if applicable).

getSitemapPriority() - Method in class com.norconex.crawler.web.ledger.WebCrawlerEntry

The document priority according to sitemap.

getSitemapResolver() - Method in class com.norconex.crawler.web.WebCrawlerConfig

The resolver of web site sitemaps (if applicable).

getSitemapSupport() - Method in class com.norconex.crawler.web.doc.operations.recrawl.impl.GenericRecrawlableResolverConfig

The sitemap support strategy.

getSitemapSupport(String) - Static method in enum class com.norconex.crawler.web.doc.operations.recrawl.impl.GenericRecrawlableResolverConfig.SitemapSupport

getSkipEmbeddedContentTypes() - Method in class com.norconex.importer.handler.parser.impl.EmbeddedConfig

Gets the content types of container files to split and treat their embedded files as separate documents.

getSkipEmbeddedOfContentTypes() - Method in class com.norconex.importer.handler.parser.impl.EmbeddedConfig

Gets the content type matchers of container files you do not want to have their embedded files parsed.

getSkipOcr() - Method in class com.norconex.importer.handler.parser.impl.OcrConfig

getSlowMo() - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcherConfig

Optional slow-motion delay applied between Playwright operations.

getSmtPath() - Method in class com.norconex.importer.handler.splitter.impl.TranslatorSplitterConfig

Moses "smtPath".

getSocketTimeout() - Method in class com.norconex.committer.elasticsearch.ElasticsearchCommitterConfig

Elasticsearch socket timeout.

getSocketTimeout() - Method in class com.norconex.crawler.fs.fetch.impl.ftp.FtpFetcherConfig

getSocketTimeout() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

Gets the maximum period of inactivity between two consecutive data packets.

getSolrClientType() - Method in class com.norconex.committer.solr.SolrCommitterConfig

The type of Solr client.

getSolrURL() - Method in class com.norconex.committer.solr.SolrCommitterConfig

The endpoint URL used to connect to Solr (as per the client type selected).

getSoTimeout() - Method in class com.norconex.crawler.fs.fetch.impl.webdav.WebDavFetcherConfig

getSourceCharset() - Method in class com.norconex.importer.handler.condition.impl.DomConditionConfig

The presumed source character encoding.

getSourceCharset() - Method in class com.norconex.importer.handler.condition.impl.ScriptConditionConfig

The presumed source character encoding.

getSourceCharset() - Method in class com.norconex.importer.handler.condition.impl.TextConditionConfig

The presumed source character encoding.

getSourceCharset() - Method in class com.norconex.importer.handler.splitter.impl.DomSplitterConfig

The presumed source character set.

getSourceCharset() - Method in class com.norconex.importer.handler.transformer.impl.CharsetTransformerConfig

getSourceCharset() - Method in class com.norconex.importer.handler.transformer.impl.CollapseRepeatingTransformerConfig

getSourceCharset() - Method in class com.norconex.importer.handler.transformer.impl.CountMatchesTransformerConfig

getSourceCharset() - Method in class com.norconex.importer.handler.transformer.impl.DomTransformerConfig

The presumed source character set.

getSourceCharset() - Method in class com.norconex.importer.handler.transformer.impl.LanguageTransformerConfig

getSourceCharset() - Method in class com.norconex.importer.handler.transformer.impl.RegexTransformerConfig

getSourceCharset() - Method in class com.norconex.importer.handler.transformer.impl.ReplaceTransformerConfig

getSourceCharset() - Method in class com.norconex.importer.handler.transformer.impl.ScriptTransformerConfig

getSourceCharset() - Method in class com.norconex.importer.handler.transformer.impl.StripAfterTransformerConfig

getSourceCharset() - Method in class com.norconex.importer.handler.transformer.impl.StripBeforeTransformerConfig

getSourceCharset() - Method in class com.norconex.importer.handler.transformer.impl.StripBetweenTransformerConfig

getSourceCharset() - Method in class com.norconex.importer.handler.transformer.impl.SubstringTransformerConfig

getSourceCharset() - Method in class com.norconex.importer.handler.transformer.impl.TextBetweenTransformerConfig

getSourceCharset() - Method in class com.norconex.importer.handler.transformer.impl.TextStatisticsTransformerConfig

getSourceCharset() - Method in class com.norconex.importer.handler.transformer.impl.TitleGeneratorTransformerConfig

getSourceCharset() - Method in class com.norconex.importer.handler.transformer.impl.UrlExtractorTransformerConfig

getSourceCharset() - Method in interface com.norconex.importer.util.chunk.ChunkedTextSupport

getSourceContentField() - Method in class com.norconex.committer.idol.IdolCommitterConfig

The document field name containing the value to be stored in IDOL DRECONTENT field.

getSourceDeltaExpansion() - Method in class com.norconex.crawler.fs.fetch.impl.m365graph.M365GraphFetcherConfig

How SOURCE_DELTA start references are expanded into Graph delta roots.

getSourceIdField() - Method in class com.norconex.committer.amazoncloudsearch.AmazonCloudSearchCommitterConfig

The document field name containing the value to be stored in CloudSearch "id" field.

getSourceIdField() - Method in class com.norconex.committer.elasticsearch.ElasticsearchCommitterConfig

The document field name containing the value to be stored in Elasticsearch "_id" field.

getSourceIdField() - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig

Metadata field holding the value to use as the document unique identifier.

getSourceIdField() - Method in class com.norconex.committer.solr.SolrCommitterConfig

The document field name containing the value to be stored in Solr ID field.

getSourceKeyField() - Method in class com.norconex.committer.azurecognitivesearch.AzureSearchCommitterConfig

The document field name containing the value to be stored in Azure Search document key field.

getSourceLanguage() - Method in class com.norconex.importer.handler.splitter.impl.TranslatorSplitterConfig

The original document language.

getSourceLanguageField() - Method in class com.norconex.importer.handler.splitter.impl.TranslatorSplitterConfig

The name of a field containing a value representing the original document language.

getSourceReferenceField() - Method in class com.norconex.committer.idol.IdolCommitterConfig

The document field name containing the value to be stored in IDOL DREREFERENCE field.

getSplitBatch() - Method in class com.norconex.committer.core.batch.queue.impl.FsQueueConfig.OnCommitFailure

Whether and how to split batches when re-attempting them when they fail See class documentation for details.

getSplitContentTypes() - Method in class com.norconex.importer.handler.parser.impl.EmbeddedConfig

Gets the content types of container files to split and treat their embedded files as separate documents.

getSpoiledReferenceStrategizer() - Method in class com.norconex.crawler.core.CrawlerConfig

The spoiled state strategy resolver.

getSqlMerge() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.JdbcHazelcastConfigurer

SQL merge/upsert template used for map stores.

getSslProtocols() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

Gets the supported SSL/TLS protocols.

getStart() - Method in class com.norconex.crawler.web.doc.operations.delay.impl.DelayRange

getStart() - Method in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractorConfig.RegexPair

getStartedAt() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.pipeline.PipelineWorkerState

getStartedAt() - Method in class com.norconex.crawler.core.cluster.pipeline.PipelineResult

getStartMatcher() - Method in class com.norconex.importer.handler.transformer.impl.StripBetweenOperation

Gets the start delimiter matcher for text to strip.

getStartMatcher() - Method in class com.norconex.importer.handler.transformer.impl.TextBetweenOperation

Gets the start delimiter matcher for text to extract.

getStartReferences() - Method in class com.norconex.crawler.core.CrawlerConfig

Gets the references to initiate crawling from.

getStartReferencesFiles() - Method in class com.norconex.crawler.core.CrawlerConfig

Gets the file paths of seed files containing references to be used as start references.

getStartReferencesProviders() - Method in class com.norconex.crawler.core.CrawlerConfig

Gets the providers of references used as starting points for crawling.

getStartReferencesSitemaps() - Method in class com.norconex.crawler.web.WebCrawlerConfig

Gets sitemap URLs to be used as starting points for crawling.

getStateStore() - Method in class com.norconex.crawler.core.session.CrawlerSession

Manages persistent crawl state and session-scoped attributes.

getStatus() - Method in class com.norconex.crawler.core.cluster.pipeline.PipelineProgress

getStatus() - Method in class com.norconex.crawler.core.cluster.pipeline.PipelineProgressBean

getStatus() - Method in interface com.norconex.crawler.core.cluster.pipeline.PipelineProgressMXBean

getStatus() - Method in class com.norconex.crawler.core.cluster.pipeline.PipelineResult

getStatus() - Method in class com.norconex.crawler.core.cluster.pipeline.StepRecord

getStatus() - Method in class com.norconex.importer.response.ImporterResponse

getStatusCode() - Method in class com.norconex.crawler.core.fetch.AggregatedFetchResponse

getStatusCode() - Method in interface com.norconex.crawler.core.fetch.FetchResponse

getStatusCode() - Method in class com.norconex.crawler.fs.fetch.impl.GenericFileFetchResponse

getStatusCode() - Method in class com.norconex.crawler.fs.fetch.impl.GenericFolderPathsFetchResponse

getStatusCode() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetchResponse

getStatusCodes() - Method in class com.norconex.crawler.web.event.listeners.UrlStatusCrawlerEventListenerConfig

The coma-separated list of status codes to listen to.

getStep(String) - Method in class com.norconex.crawler.core.cluster.pipeline.Pipeline

getStepCount() - Method in class com.norconex.crawler.core.cluster.pipeline.PipelineProgress

getStepCount() - Method in class com.norconex.crawler.core.cluster.pipeline.PipelineProgressBean

getStepCount() - Method in interface com.norconex.crawler.core.cluster.pipeline.PipelineProgressMXBean

getStepId() - Method in class com.norconex.crawler.core.cluster.pipeline.StepRecord

getStepMessage() - Method in class com.norconex.crawler.core.cluster.pipeline.PipelineProgress

getStepMessage() - Method in class com.norconex.crawler.core.cluster.pipeline.PipelineProgressBean

getStepMessage() - Method in interface com.norconex.crawler.core.cluster.pipeline.PipelineProgressMXBean

getStepProgress() - Method in class com.norconex.crawler.core.cluster.pipeline.PipelineProgress

getStepProgress() - Method in class com.norconex.crawler.core.cluster.pipeline.PipelineProgressBean

getStepProgress() - Method in interface com.norconex.crawler.core.cluster.pipeline.PipelineProgressMXBean

getSteps() - Method in class com.norconex.crawler.core.cluster.pipeline.Pipeline

getStopOnExceptions() - Method in class com.norconex.crawler.core.CrawlerConfig

The exceptions we want to stop the crawler on.

getStopRequested() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.pipeline.PipelineCoordinatorState

getStopRequested() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.pipeline.PipelineWorkerState

getStorageDiskDir() - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig

Path to directory where to store images on disk.

getStorageDiskField() - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig

Name of metadata field where to store the local path to an image.

getStorageDiskStructure() - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig

The type of directory structure to create when one of the values of of FeaturedImageResolverConfig.getStorages() is FeaturedImageResolverConfig.Storage.DISK.

getStorageInlineField() - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig

Name of metadata field where to store the Base64 image.

getStorages() - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig

Gets the storages mechanisms.

getStorageUrlField() - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig

Name of metadata field where to store the remote image URL.

getStream(String) - Method in class com.norconex.crawler.fs.fetch.impl.cmis.CmisAtomSession

getStreamFactory() - Method in class com.norconex.committer.core.CommitterContext

getStreamFactory() - Method in class com.norconex.crawler.core.context.CrawlerContext

getStreamFactory() - Method in class com.norconex.importer.doc.Doc

getStrictHostKeyChecking() - Method in class com.norconex.crawler.fs.fetch.impl.sftp.SftpFetcherConfig

getString(String) - Method in class com.norconex.crawler.core.session.CrawlerAttributes

Gets an attribute as a string.

getStrings() - Method in class com.norconex.importer.handler.transformer.impl.CollapseRepeatingTransformerConfig

getStripAfterMatcher() - Method in class com.norconex.importer.handler.transformer.impl.StripAfterTransformerConfig

Gets the matcher of text after which to strip.

getStripBeforeMatcher() - Method in class com.norconex.importer.handler.transformer.impl.StripBeforeTransformerConfig

Gets the matcher for the text up to which to strip content.

getStructuredDataMappings() - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig

getSubject() - Method in class com.norconex.committer.core.service.CommitterServiceEvent

getSuffix() - Method in class com.norconex.importer.handler.transformer.impl.TruncateTransformerConfig

getSupportedTypes(ParseContext) - Method in class com.norconex.importer.handler.parser.impl.XfdlTikaParser

getT() - Method in class com.norconex.importer.handler.parser.impl.ExternalParser

getTableName() - Method in class com.norconex.committer.sql.SqlCommitterConfig

The target database table name where documents will be committed.

getTagAttribs() - Method in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractorConfig

getTarget() - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.AclMapping

Which ACL list the resolved principal(s) are added to.

getTargetCharset() - Method in class com.norconex.importer.handler.transformer.impl.CharsetTransformerConfig

getTargetContentField() - Method in class com.norconex.committer.amazoncloudsearch.AmazonCloudSearchCommitterConfig

The name of the CloudSearch field where content will be stored.

getTargetContentField() - Method in class com.norconex.committer.azurecognitivesearch.AzureSearchCommitterConfig

The name of the Azure Search field where content will be stored.

getTargetContentField() - Method in class com.norconex.committer.elasticsearch.ElasticsearchCommitterConfig

The name of the Elasticsearch field where content will be stored.

getTargetContentField() - Method in class com.norconex.committer.solr.SolrCommitterConfig

The name of the Solr field where content will be stored.

getTargetContentField() - Method in class com.norconex.committer.sql.SqlCommitterConfig

Table field name where to store the document content stream.

getTargetDir() - Method in class com.norconex.crawler.web.fetch.util.DocImageHandlerConfig

getTargetDirField() - Method in class com.norconex.crawler.web.fetch.util.DocImageHandlerConfig

getTargetDirStructure() - Method in class com.norconex.crawler.web.fetch.util.DocImageHandlerConfig

getTargetFormat() - Method in class com.norconex.importer.handler.transformer.impl.ImageTransformerConfig

getTargetIdField() - Method in class com.norconex.committer.solr.SolrCommitterConfig

The name of the Solr field where to store a document unique identifier (sourceIdField).

getTargetKeyField() - Method in class com.norconex.committer.azurecognitivesearch.AzureSearchCommitterConfig

The name of Azure Search key field where to store a document unique identifier (sourceKeyField).

getTargetLanguages() - Method in class com.norconex.importer.handler.splitter.impl.TranslatorSplitterConfig

getTargetMetaField() - Method in class com.norconex.crawler.web.fetch.util.DocImageHandlerConfig

getTargets() - Method in class com.norconex.crawler.web.fetch.util.DocImageHandlerConfig

getTcpMembers() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.JdbcHazelcastConfigurer

TCP/IP member list for clustered discovery, as a comma-separated list of host:port addresses (e.g., "192.168.1.10:5701,192.168.1.11:5701").

getTempDir() - Method in class com.norconex.crawler.core.context.CrawlerContext

getTempDir() - Method in class com.norconex.importer.handler.transformer.impl.ExternalTransformerConfig

The directory where to store temporary files sent to the external handler as file paths.

getTempDir() - Method in class com.norconex.importer.ImporterConfig

The temporary directory where files can be deleted safely by the OS or any other processes when the Importer is not running.

getTenantId() - Method in class com.norconex.crawler.fs.fetch.impl.m365graph.M365GraphFetcherConfig

Tenant ID used to acquire an access token.

getTessdataPath() - Method in class com.norconex.importer.handler.parser.impl.OcrConfig

getTesseractPath() - Method in class com.norconex.importer.handler.parser.impl.OcrConfig

getText() - Method in class com.norconex.importer.util.chunk.TextChunk

Full or partial text depending whether the maximum read size was reached and it needed to be sent in text chunks.

getThenHandlers() - Method in class com.norconex.importer.handler.condition.ConditionalDocHandler

getThreadFactoryCreator() - Method in class com.norconex.crawler.core.context.CrawlerContext

getThreadWait() - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig

Makes the current thread sleep for the specified duration, to give the web driver enough time to load the page.

getTikaConfigFile() - Method in class com.norconex.importer.handler.parser.impl.TikaParserConfig

The path to a Tika configuration file.

getTimeoutSeconds() - Method in class com.norconex.importer.handler.parser.impl.OcrConfig

getTimeRange() - Method in class com.norconex.crawler.web.doc.operations.delay.impl.DelaySchedule

getTimeUnit(String) - Static method in enum class com.norconex.importer.handler.condition.impl.DateCondition.TimeUnit

getTitleMaxLength() - Method in class com.norconex.importer.handler.transformer.impl.TitleGeneratorTransformerConfig

getTlsVersions() - Method in class com.norconex.crawler.fs.fetch.impl.webdav.WebDavFetcherConfig

getToField() - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.MetadataMapping

Mandatory target Google Cloud Search metadata field.

getToField() - Method in class com.norconex.crawler.core.doc.operations.checksum.BaseChecksummerConfig

The metadata field to use to store the checksum value.

getToField() - Method in class com.norconex.importer.handler.transformer.impl.CopyOperation

getToField() - Method in class com.norconex.importer.handler.transformer.impl.CountMatchesTransformerConfig

The target field.

getToField() - Method in class com.norconex.importer.handler.transformer.impl.CurrentDateTransformerConfig

The target field.

getToField() - Method in class com.norconex.importer.handler.transformer.impl.DateFormatTransformerConfig

getToField() - Method in class com.norconex.importer.handler.transformer.impl.DocumentLengthTransformerConfig

Gets the target field.

getToField() - Method in class com.norconex.importer.handler.transformer.impl.DomOperation

The target field for extracted content.

getToField() - Method in class com.norconex.importer.handler.transformer.impl.HierarchyOperation

getToField() - Method in class com.norconex.importer.handler.transformer.impl.MergeOperation

getToField() - Method in class com.norconex.importer.handler.transformer.impl.RenameOperation

getToField() - Method in class com.norconex.importer.handler.transformer.impl.ReplaceOperation

getToField() - Method in class com.norconex.importer.handler.transformer.impl.SplitOperation

getToField() - Method in class com.norconex.importer.handler.transformer.impl.TextBetweenOperation

The target field for extracted text.

getToField() - Method in class com.norconex.importer.handler.transformer.impl.TitleGeneratorTransformerConfig

getToField() - Method in class com.norconex.importer.handler.transformer.impl.TruncateTransformerConfig

getToField() - Method in class com.norconex.importer.handler.transformer.impl.UrlExtractorTransformerConfig

getToField() - Method in class com.norconex.importer.handler.transformer.impl.UuidTransformerConfig

The target field.

getToFormat() - Method in class com.norconex.importer.handler.transformer.impl.DateFormatTransformerConfig

getToLocale() - Method in class com.norconex.importer.handler.transformer.impl.DateFormatTransformerConfig

The locale used for formatting the target date.

getTopicName() - Method in class com.norconex.committer.apachekafka.ApacheKafkaCommitterConfig

The topic name to which documents will be sent

getToSeparator() - Method in class com.norconex.importer.handler.transformer.impl.HierarchyOperation

getToString() - Method in class com.norconex.importer.handler.condition.impl.DateProviderFactory.StaticDateTimeProvider

getToValue() - Method in class com.norconex.importer.handler.transformer.impl.ReplaceOperation

getTruncateAt() - Method in class com.norconex.committer.core.fs.impl.CsvColumn

getTruncateAt() - Method in class com.norconex.committer.core.fs.impl.CsvFileCommitterConfig

Number of characters from which long text will be truncated.

getTruncateSamplesAt() - Method in class com.norconex.importer.handler.transformer.impl.FieldReportTransformerConfig

getType() - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.StructuredDataMapping

Value type to use for this field.

getTypeHeader() - Method in class com.norconex.committer.core.fs.impl.CsvFileCommitterConfig

When generating CSV files containing both upserts and deletes requests, what column name to use to display the request type.

getTypeName() - Method in class com.norconex.committer.elasticsearch.ElasticsearchCommitterConfig

The type name.

getTypeName() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.JacksonCompactSerializer

getTypeName() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.StepRecordCompactSerializer

getUnderAMinute(Future<T>) - Static method in class com.norconex.crawler.core.util.ConcurrentUtil

getUnderSecs(Future<T>, int) - Static method in class com.norconex.crawler.core.util.ConcurrentUtil

getUpdatedAt() - Method in class com.norconex.crawler.core.cluster.pipeline.StepRecord

getUpdateUrlParam(String) - Method in class com.norconex.committer.solr.SolrCommitterConfig

Gets a URL parameter value by its parameter name.

getUpdateUrlParamNames() - Method in class com.norconex.committer.solr.SolrCommitterConfig

Gets the update URL parameter names.

getUpdateUrlParams() - Method in class com.norconex.committer.solr.SolrCommitterConfig

Gets URL parameters to be added on Solr HTTP calls.

getUploadFormat() - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig

The format used to upload document content.

getUpsertCount() - Method in class com.norconex.committer.core.impl.MemoryCommitter

getUpsertCypher() - Method in class com.norconex.committer.neo4j.Neo4jCommitterConfig

Cypher query for adding relationships to Neo4j.

getUpsertRequestBuilder() - Method in class com.norconex.committer.core.service.CommitterService

getUpsertRequests() - Method in class com.norconex.committer.core.impl.MemoryCommitter

getUri() - Method in class com.norconex.committer.neo4j.Neo4jCommitterConfig

Required connection URI.

getUri() - Method in class com.norconex.crawler.fs.fetch.FsPath

getUrl() - Method in class com.norconex.committer.idol.IdolCommitterConfig

The IDOL/DIH/CFS index action URL.

getUrl() - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImage

getUrl() - Method in class com.norconex.crawler.web.doc.operations.link.Link

getUrl() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthConfig

The URL for "form" authentication.

getUrlCharset() - Method in class com.norconex.crawler.fs.fetch.impl.webdav.WebDavFetcherConfig

getUrlConsumer() - Method in class com.norconex.crawler.web.doc.operations.sitemap.SitemapContext

getUrlNormalizers() - Method in class com.norconex.crawler.web.WebCrawlerConfig

Gets URL normalizers.

getUrlRoot() - Method in class com.norconex.crawler.web.ledger.WebCrawlerEntry

Gets the URL root (protocol + domain, e.g. http://www.host.com).

getUrlScopeResolver() - Method in class com.norconex.crawler.web.WebCrawlerConfig

The strategy to use to determine if a URL is in scope.

getUserAgent() - Method in class com.norconex.crawler.fs.fetch.impl.webdav.WebDavFetcherConfig

getUserAgent() - Method in class com.norconex.crawler.web.fetch.AggregatedWebFetchResponse

getUserAgent() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcher

getUserAgent() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

The user-agent used when identifying the crawler to targeted web sites.

getUserAgent() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetchResponse

getUserAgent() - Method in class com.norconex.crawler.web.fetch.impl.webdriver.HttpSnifferConfig

Optionally overwrite browser user agent.

getUserAgent() - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcher

getUserAgent() - Method in interface com.norconex.crawler.web.fetch.WebFetchResponse

getUserKey() - Method in class com.norconex.importer.handler.splitter.impl.TranslatorSplitterConfig

Lingo24 user key.

getUserPrincipalLookupService() - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyFileSystem

getValidStatusCodes() - Method in class com.norconex.crawler.fs.fetch.impl.box.BoxFetcherConfig

getValidStatusCodes() - Method in class com.norconex.crawler.fs.fetch.impl.egnyte.EgnyteFetcherConfig

getValidStatusCodes() - Method in class com.norconex.crawler.fs.fetch.impl.m365graph.M365GraphFetcherConfig

getValidStatusCodes() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

Sets valid HTTP response status codes.

getValue() - Method in class com.norconex.crawler.web.doc.operations.recrawl.impl.GenericRecrawlableResolverConfig.MinFrequency

String representation of a frequency.

getValue() - Method in class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizerConfig.NormalizationReplace

getValueClass() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.jdbc.TypedJdbcMapStoreFactory

getValueClass() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.jdbc.TypedJdbcQueueStoreFactory

getValueClass() - Method in interface com.norconex.crawler.core.cluster.impl.hazelcast.LazyTypedStoreFactory

getValueMatcher() - Method in class com.norconex.crawler.core.doc.operations.filter.impl.GenericMetadataFilterConfig

Gets the value matcher.

getValueMatcher() - Method in class com.norconex.crawler.core.doc.operations.filter.impl.GenericReferenceFilterConfig

Gets the value matcher.

getValueMatcher() - Method in class com.norconex.importer.handler.condition.impl.DateConditionConfig

Value matcher for a date, or the begining of a date range (if an end date value matcher is also supplied).

getValueMatcher() - Method in class com.norconex.importer.handler.condition.impl.DomConditionConfig

Gets this condition value matcher.

getValueMatcher() - Method in class com.norconex.importer.handler.condition.impl.NumericConditionConfig

getValueMatcher() - Method in class com.norconex.importer.handler.condition.impl.ReferenceConditionConfig

Gets the text matcher for field values.

getValueMatcher() - Method in class com.norconex.importer.handler.condition.impl.TextConditionConfig

Gets the text matcher for content or field values.

getValueMatcher() - Method in class com.norconex.importer.handler.transformer.impl.ReplaceOperation

Gets value matcher.

getValueMatcherRangeEnd() - Method in class com.norconex.importer.handler.condition.impl.DateConditionConfig

Value matcher for then end of a date range.

getValueMatcherRangeEnd() - Method in class com.norconex.importer.handler.condition.impl.NumericConditionConfig

getValues() - Method in class com.norconex.importer.handler.transformer.impl.Constant

getVariablesFile() - Method in class com.norconex.crawler.core.cli.CliBase

getWaitForElementSelector() - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcherConfig

Selector expression used to wait for a specific element to appear in the page before returning.

getWaitForElementSelector() - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig

Reference to an element to wait for.

getWaitForElementTimeout() - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcherConfig

Maximum time to wait for the element identified by PlaywrightFetcherConfig.getWaitForElementSelector() to appear.

getWaitForElementTimeout() - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig

Max wait time for an element to show up in browser before returning.

getWaitForElementType() - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcherConfig

The type of reference used when waiting for an element to appear.

getWaitForElementType() - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig

The type of reference to use when waiting for an element.

getWatch() - Method in class com.norconex.committer.core.impl.LogCommitter

getWidth() - Method in class com.norconex.importer.handler.transformer.impl.ImageTransformerConfig.Crop

getWidth() - Method in class com.norconex.importer.handler.transformer.impl.ImageTransformerConfig.Scale

getWindowSize() - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcherConfig

Optional browser viewport size.

getWindowSize() - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig

Optionally set the browser window dimensions.

getWorkDir() - Method in class com.norconex.committer.core.CommitterContext

Gets a unique working directory for a committer (if one is needed).

getWorkDir() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastCluster

getWorkDir() - Method in class com.norconex.crawler.core.context.CrawlerContext

getWorkDir() - Method in class com.norconex.crawler.core.CrawlerConfig

The base directory location where files generated during execution will reside.

getWorkerHeartbeatInterval() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastClusterConnectorConfig

Interval at which worker nodes send heartbeat updates for their current pipeline status to the coordinator.

getWorkstation() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthConfig

The NTLM authentication workstation name.

getWriteBatchSize() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.JdbcHazelcastConfigurer

Maximum number of entries per write-behind batch.

getWriteDelaySeconds() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.JdbcHazelcastConfigurer

Write-behind delay in seconds for data maps (ledger, session, etc.).

getX() - Method in class com.norconex.importer.handler.transformer.impl.ImageTransformerConfig.Crop

getXmlTargetField() - Method in class com.norconex.crawler.fs.fetch.impl.cmis.CmisFetcherConfig

The name of the field where the raw XML obtained from the CMIS REST API will be stored.

getY() - Method in class com.norconex.importer.handler.transformer.impl.ImageTransformerConfig.Crop

getZoneId() - Method in interface com.norconex.importer.handler.condition.impl.DateProvider

The zone ID, which should always be the same for this instance, regardless whether the date-time is dynamic or static.

getZoneId() - Method in class com.norconex.importer.handler.condition.impl.DateProviderFactory.DynamicFixedDateTimeProvider

getZoneId() - Method in class com.norconex.importer.handler.condition.impl.DateProviderFactory.DynamicFloatingDateTimeProvider

getZoneId() - Method in class com.norconex.importer.handler.condition.impl.DateProviderFactory.StaticDateTimeProvider

GoogleCloudSearchCommitter - Class in com.norconex.committer.googlecloudsearch

Commits documents to Google Cloud Search using the official Google API client.

GoogleCloudSearchCommitter() - Constructor for class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitter

GoogleCloudSearchCommitterConfig - Class in com.norconex.committer.googlecloudsearch

Google Cloud Search Committer configuration.

GoogleCloudSearchCommitterConfig() - Constructor for class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig

GoogleCloudSearchCommitterConfig.AclInheritanceMapping - Class in com.norconex.committer.googlecloudsearch

Declares which metadata field holds a parent item reference to use for Google Cloud Search ACL inheritance.

GoogleCloudSearchCommitterConfig.AclInheritanceType - Enum Class in com.norconex.committer.googlecloudsearch

How ACLs are inherited from a parent item.

GoogleCloudSearchCommitterConfig.AclMapping - Class in com.norconex.committer.googlecloudsearch

Maps a metadata field to a Google Cloud Search ACL principal.

GoogleCloudSearchCommitterConfig.AclTarget - Enum Class in com.norconex.committer.googlecloudsearch

Target of an ACL mapping.

GoogleCloudSearchCommitterConfig.MetadataMapping - Class in com.norconex.committer.googlecloudsearch

Maps crawler metadata fields to Google Cloud Search predefined metadata fields.

GoogleCloudSearchCommitterConfig.PrincipalType - Enum Class in com.norconex.committer.googlecloudsearch

Type of principal an ACL mapping resolves to.

GoogleCloudSearchCommitterConfig.RequestMode - Enum Class in com.norconex.committer.googlecloudsearch

Priority/consistency mode used for indexing and delete requests.

GoogleCloudSearchCommitterConfig.StructuredDataMapping - Class in com.norconex.committer.googlecloudsearch

Declares the Google Cloud Search structured data value type to use for a given metadata field sent as structured data.

GoogleCloudSearchCommitterConfig.StructuredDataType - Enum Class in com.norconex.committer.googlecloudsearch

Google Cloud Search structured data value type.

GoogleCloudSearchCommitterConfig.UploadFormat - Enum Class in com.norconex.committer.googlecloudsearch

Format used to upload document content.

GoogleCloudSearchCommitterPtProvider - Class in com.norconex.committer.googlecloudsearch.spi

For auto registering in BeanMapper.

GoogleCloudSearchCommitterPtProvider() - Constructor for class com.norconex.committer.googlecloudsearch.spi.GoogleCloudSearchCommitterPtProvider

GoogleDriveFetcher - Class in com.norconex.crawler.fs.fetch.impl.googledrive

Google Drive API fetcher for Google Workspace My Drive and Shared Drives.

GoogleDriveFetcher() - Constructor for class com.norconex.crawler.fs.fetch.impl.googledrive.GoogleDriveFetcher

GoogleDriveFetcherConfig - Class in com.norconex.crawler.fs.fetch.impl.googledrive

Configuration scaffold for a future GoogleDriveFetcher implementation.

GoogleDriveFetcherConfig() - Constructor for class com.norconex.crawler.fs.fetch.impl.googledrive.GoogleDriveFetcherConfig

GoogleDriveFetcherConfig.NativeDocumentFormatPolicy - Enum Class in com.norconex.crawler.fs.fetch.impl.googledrive

GRACE_ONCE - Enum constant in enum class com.norconex.crawler.core.doc.operations.spoil.SpoiledReferenceStrategy

Gracing spoiled references gives them one chance (and only one) to recover by not sending a deletion request to the Committer the first time, but doing so if the reference is still spoiled on the next crawl.

gridCache(CrawlerSession, String, Class<? extends T>) - Static method in class com.norconex.crawler.web.util.Web

GrobidConfig - Class in com.norconex.importer.handler.parser.impl

Grobid REST service configuration.

GrobidConfig() - Constructor for class com.norconex.importer.handler.parser.impl.GrobidConfig

GROUP - Enum constant in enum class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.PrincipalType

H

HALF - Enum constant in enum class com.norconex.committer.core.batch.queue.impl.FsQueue.SplitBatch

handle(DocHandlerContext) - Method in class com.norconex.importer.handler.condition.ConditionalDocHandler

handle(DocHandlerContext) - Method in interface com.norconex.importer.handler.DocHandler

Perform any operations on a document.

handle(DocHandlerContext) - Method in class com.norconex.importer.handler.parser.impl.DefaultParser

handle(DocHandlerContext) - Method in class com.norconex.importer.handler.parser.impl.ExternalParser

handle(DocHandlerContext) - Method in class com.norconex.importer.handler.parser.impl.TikaParser

handle(DocHandlerContext) - Method in class com.norconex.importer.handler.Reject

handle(DocHandlerContext) - Method in class com.norconex.importer.handler.splitter.AbstractDocumentSplitter

handle(DocHandlerContext) - Method in class com.norconex.importer.handler.transformer.impl.BinaryContentTransformer

handle(DocHandlerContext) - Method in class com.norconex.importer.handler.transformer.impl.CharacterCaseTransformer

handle(DocHandlerContext) - Method in class com.norconex.importer.handler.transformer.impl.CharsetTransformer

handle(DocHandlerContext) - Method in class com.norconex.importer.handler.transformer.impl.CollapseRepeatingTransformer

handle(DocHandlerContext) - Method in class com.norconex.importer.handler.transformer.impl.ConstantTransformer

handle(DocHandlerContext) - Method in class com.norconex.importer.handler.transformer.impl.CopyTransformer

handle(DocHandlerContext) - Method in class com.norconex.importer.handler.transformer.impl.CountMatchesTransformer

handle(DocHandlerContext) - Method in class com.norconex.importer.handler.transformer.impl.CurrentDateTransformer

handle(DocHandlerContext) - Method in class com.norconex.importer.handler.transformer.impl.DateFormatTransformer

handle(DocHandlerContext) - Method in class com.norconex.importer.handler.transformer.impl.DebugTransformer

handle(DocHandlerContext) - Method in class com.norconex.importer.handler.transformer.impl.DeleteTransformer

handle(DocHandlerContext) - Method in class com.norconex.importer.handler.transformer.impl.DocumentLengthTransformer

handle(DocHandlerContext) - Method in class com.norconex.importer.handler.transformer.impl.DomTransformer

handle(DocHandlerContext) - Method in class com.norconex.importer.handler.transformer.impl.ExternalTransformer

handle(DocHandlerContext) - Method in class com.norconex.importer.handler.transformer.impl.FieldReportTransformer

handle(DocHandlerContext) - Method in class com.norconex.importer.handler.transformer.impl.ForceSingleValueTransformer

handle(DocHandlerContext) - Method in class com.norconex.importer.handler.transformer.impl.HierarchyTransformer

handle(DocHandlerContext) - Method in class com.norconex.importer.handler.transformer.impl.ImageTransformer

handle(DocHandlerContext) - Method in class com.norconex.importer.handler.transformer.impl.KeepOnlyTransformer

handle(DocHandlerContext) - Method in class com.norconex.importer.handler.transformer.impl.LanguageTransformer

handle(DocHandlerContext) - Method in class com.norconex.importer.handler.transformer.impl.MergeTransformer

handle(DocHandlerContext) - Method in class com.norconex.importer.handler.transformer.impl.RegexTransformer

handle(DocHandlerContext) - Method in class com.norconex.importer.handler.transformer.impl.RenameTransformer

handle(DocHandlerContext) - Method in class com.norconex.importer.handler.transformer.impl.ReplaceTransformer

handle(DocHandlerContext) - Method in class com.norconex.importer.handler.transformer.impl.SaveDocumentTransformer

handle(DocHandlerContext) - Method in class com.norconex.importer.handler.transformer.impl.ScriptTransformer

handle(DocHandlerContext) - Method in class com.norconex.importer.handler.transformer.impl.SplitTransformer

handle(DocHandlerContext) - Method in class com.norconex.importer.handler.transformer.impl.StripAfterTransformer

handle(DocHandlerContext) - Method in class com.norconex.importer.handler.transformer.impl.StripBeforeTransformer

handle(DocHandlerContext) - Method in class com.norconex.importer.handler.transformer.impl.StripBetweenTransformer

handle(DocHandlerContext) - Method in class com.norconex.importer.handler.transformer.impl.SubstringTransformer

handle(DocHandlerContext) - Method in class com.norconex.importer.handler.transformer.impl.TextBetweenTransformer

handle(DocHandlerContext) - Method in class com.norconex.importer.handler.transformer.impl.TextStatisticsTransformer

handle(DocHandlerContext) - Method in class com.norconex.importer.handler.transformer.impl.TitleGeneratorTransformer

handle(DocHandlerContext) - Method in class com.norconex.importer.handler.transformer.impl.TruncateTransformer

handle(DocHandlerContext) - Method in class com.norconex.importer.handler.transformer.impl.UrlExtractorTransformer

handle(DocHandlerContext) - Method in class com.norconex.importer.handler.transformer.impl.UuidTransformer

handleImage(InputStream, Doc) - Method in class com.norconex.crawler.web.fetch.util.DocImageHandler

Handling Failures - Search tag in class com.norconex.committer.core.batch.queue.impl.FsQueue

Section

Handling of missing table/fields - Search tag in class com.norconex.committer.sql.SqlCommitter

Section

HASH - Enum constant in enum class com.norconex.committer.googlecloudsearch.MetadataField

hashCode() - Method in class com.norconex.committer.amazoncloudsearch.AmazonCloudSearchCommitter

hashCode() - Method in class com.norconex.committer.amazoncloudsearch.AmazonCloudSearchCommitterConfig

hashCode() - Method in class com.norconex.committer.apachekafka.ApacheKafkaCommitter

hashCode() - Method in class com.norconex.committer.apachekafka.ApacheKafkaCommitterConfig

hashCode() - Method in class com.norconex.committer.azurecognitivesearch.AzureSearchCommitter

hashCode() - Method in class com.norconex.committer.azurecognitivesearch.AzureSearchCommitterConfig

hashCode() - Method in class com.norconex.committer.core.AbstractCommitter

hashCode() - Method in class com.norconex.committer.core.BaseCommitterConfig

hashCode() - Method in class com.norconex.committer.core.batch.AbstractBatchCommitter

hashCode() - Method in class com.norconex.committer.core.batch.BaseBatchCommitterConfig

hashCode() - Method in class com.norconex.committer.core.batch.queue.impl.FsQueue

hashCode() - Method in class com.norconex.committer.core.batch.queue.impl.FsQueueConfig

hashCode() - Method in class com.norconex.committer.core.batch.queue.impl.FsQueueConfig.OnCommitFailure

hashCode() - Method in class com.norconex.committer.core.CommitterContext

hashCode() - Method in class com.norconex.committer.core.CommitterEvent

hashCode() - Method in class com.norconex.committer.core.DeleteRequest

hashCode() - Method in class com.norconex.committer.core.fs.AbstractFsCommitter

hashCode() - Method in class com.norconex.committer.core.fs.BaseFsCommitterConfig

hashCode() - Method in class com.norconex.committer.core.fs.impl.CsvColumn

hashCode() - Method in class com.norconex.committer.core.fs.impl.CsvFileCommitter

hashCode() - Method in class com.norconex.committer.core.fs.impl.CsvFileCommitterConfig

hashCode() - Method in class com.norconex.committer.core.fs.impl.JsonFileCommitter

hashCode() - Method in class com.norconex.committer.core.fs.impl.JsonFileCommitterConfig

hashCode() - Method in class com.norconex.committer.core.fs.impl.XmlFileCommitter

hashCode() - Method in class com.norconex.committer.core.fs.impl.XmlFileCommitterConfig

hashCode() - Method in class com.norconex.committer.core.impl.LogCommitter

hashCode() - Method in class com.norconex.committer.core.impl.LogCommitterConfig

hashCode() - Method in class com.norconex.committer.core.impl.MemoryCommitter

hashCode() - Method in class com.norconex.committer.core.impl.MemoryCommitterConfig

hashCode() - Method in class com.norconex.committer.core.service.CommitterService

hashCode() - Method in class com.norconex.committer.core.service.CommitterServiceEvent

hashCode() - Method in class com.norconex.committer.core.UpsertRequest

hashCode() - Method in class com.norconex.committer.elasticsearch.ElasticsearchCommitter

hashCode() - Method in class com.norconex.committer.elasticsearch.ElasticsearchCommitterConfig

hashCode() - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitter

hashCode() - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.AclInheritanceMapping

hashCode() - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.AclMapping

hashCode() - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig

hashCode() - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.MetadataMapping

hashCode() - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.StructuredDataMapping

hashCode() - Method in class com.norconex.committer.idol.IdolCommitter

hashCode() - Method in class com.norconex.committer.idol.IdolCommitterConfig

hashCode() - Method in class com.norconex.committer.neo4j.Neo4jCommitter

hashCode() - Method in class com.norconex.committer.neo4j.Neo4jCommitterConfig

hashCode() - Method in class com.norconex.committer.solr.SolrCommitter

hashCode() - Method in class com.norconex.committer.solr.SolrCommitterConfig

hashCode() - Method in class com.norconex.committer.sql.SqlCommitter

hashCode() - Method in class com.norconex.committer.sql.SqlCommitterConfig

hashCode() - Method in class com.norconex.crawler.core.cli.CliBase

hashCode() - Method in class com.norconex.crawler.core.cli.CliConfigRender

hashCode() - Method in class com.norconex.crawler.core.cli.CliRunner

hashCode() - Method in class com.norconex.crawler.core.cli.CliStart

hashCode() - Method in class com.norconex.crawler.core.cli.CliStop

hashCode() - Method in class com.norconex.crawler.core.cli.CliStoreExport

hashCode() - Method in class com.norconex.crawler.core.cli.CliStoreImport

hashCode() - Method in class com.norconex.crawler.core.cluster.ClusterConfig

hashCode() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastCluster

hashCode() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastClusterConnector

hashCode() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastClusterConnectorConfig

hashCode() - Method in record class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastConfigurerContext

Returns a hash code value for this object.

hashCode() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.JdbcHazelcastConfigurer

hashCode() - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreClusterConnector

hashCode() - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreClusterConnectorConfig

hashCode() - Method in class com.norconex.crawler.core.cluster.pipeline.BaseStep

hashCode() - Method in class com.norconex.crawler.core.cluster.pipeline.Pipeline

hashCode() - Method in class com.norconex.crawler.core.cluster.pipeline.PipelineProgress

hashCode() - Method in class com.norconex.crawler.core.cluster.pipeline.PipelineResult

hashCode() - Method in class com.norconex.crawler.core.cluster.pipeline.Step.StepProgress

hashCode() - Method in class com.norconex.crawler.core.cluster.pipeline.StepRecord

hashCode() - Method in class com.norconex.crawler.core.cluster.QueryFilter

hashCode() - Method in class com.norconex.crawler.core.cluster.SerializedCache

hashCode() - Method in class com.norconex.crawler.core.cluster.SerializedCache.SerializedEntry

hashCode() - Method in class com.norconex.crawler.core.cluster.SerializedRecord

hashCode() - Method in class com.norconex.crawler.core.cmd.crawl.CrawlerProgressLogger

hashCode() - Method in class com.norconex.crawler.core.cmd.crawl.pipeline.bootstrap.queue.QueueBootstrapper

hashCode() - Method in class com.norconex.crawler.core.cmd.crawl.pipeline.process.CrawlerProcessStep

hashCode() - Method in class com.norconex.crawler.core.context.CrawlerContext

hashCode() - Method in class com.norconex.crawler.core.context.CrawlerContextFactory.Builder

hashCode() - Method in class com.norconex.crawler.core.CrawlerConfig

hashCode() - Method in class com.norconex.crawler.core.CrawlerDriver.FetchDriver

hashCode() - Method in class com.norconex.crawler.core.doc.operations.checksum.AbstractDocumentChecksummer

hashCode() - Method in class com.norconex.crawler.core.doc.operations.checksum.AbstractMetadataChecksummer

hashCode() - Method in class com.norconex.crawler.core.doc.operations.checksum.BaseChecksummerConfig

hashCode() - Method in class com.norconex.crawler.core.doc.operations.checksum.impl.GenericMetadataChecksummer

hashCode() - Method in class com.norconex.crawler.core.doc.operations.checksum.impl.GenericMetadataChecksummerConfig

hashCode() - Method in class com.norconex.crawler.core.doc.operations.checksum.impl.Md5DocumentChecksummer

hashCode() - Method in class com.norconex.crawler.core.doc.operations.checksum.impl.Md5DocumentChecksummerConfig

hashCode() - Method in class com.norconex.crawler.core.doc.operations.filter.impl.ExtensionReferenceFilter

hashCode() - Method in class com.norconex.crawler.core.doc.operations.filter.impl.ExtensionReferenceFilterConfig

hashCode() - Method in class com.norconex.crawler.core.doc.operations.filter.impl.GenericMetadataFilter

hashCode() - Method in class com.norconex.crawler.core.doc.operations.filter.impl.GenericMetadataFilterConfig

hashCode() - Method in class com.norconex.crawler.core.doc.operations.filter.impl.GenericReferenceFilter

hashCode() - Method in class com.norconex.crawler.core.doc.operations.filter.impl.GenericReferenceFilterConfig

hashCode() - Method in class com.norconex.crawler.core.doc.operations.spoil.impl.GenericSpoiledReferenceStrategizer

hashCode() - Method in class com.norconex.crawler.core.doc.operations.spoil.impl.GenericSpoiledReferenceStrategizerConfig

hashCode() - Method in class com.norconex.crawler.core.doc.pipelines.committer.CommitterPipelineContext

hashCode() - Method in class com.norconex.crawler.core.doc.pipelines.importer.ImporterPipelineContext

hashCode() - Method in class com.norconex.crawler.core.doc.pipelines.queue.QueuePipelineContext

hashCode() - Method in class com.norconex.crawler.core.event.CrawlerEvent

hashCode() - Method in class com.norconex.crawler.core.event.listeners.CrawlerLifeCycleListener

hashCode() - Method in class com.norconex.crawler.core.event.listeners.DeleteRejectedEventListener

hashCode() - Method in class com.norconex.crawler.core.event.listeners.DeleteRejectedEventListenerConfig

hashCode() - Method in class com.norconex.crawler.core.event.listeners.StopCrawlerOnMaxEventListener

hashCode() - Method in class com.norconex.crawler.core.event.listeners.StopCrawlerOnMaxEventListenerConfig

hashCode() - Method in class com.norconex.crawler.core.fetch.AbstractFetcher

hashCode() - Method in class com.norconex.crawler.core.fetch.AggregatedFetchResponse

hashCode() - Method in class com.norconex.crawler.core.fetch.BaseFetcherConfig

hashCode() - Method in class com.norconex.crawler.core.ledger.CrawlerEntry

hashCode() - Method in class com.norconex.crawler.core.ledger.ProcessingOutcome

hashCode() - Method in class com.norconex.crawler.core.session.CrawlerRunInfo

hashCode() - Method in class com.norconex.crawler.core.session.CrawlerSession.State

hashCode() - Method in class com.norconex.crawler.fs.doc.operations.checksum.FsMetadataChecksummer

hashCode() - Method in class com.norconex.crawler.fs.fetch.AggregatedFileFetchResponse

hashCode() - Method in class com.norconex.crawler.fs.fetch.AggregatedFolderPathsResponse

hashCode() - Method in class com.norconex.crawler.fs.fetch.FileFetchRequest

hashCode() - Method in class com.norconex.crawler.fs.fetch.FolderPathsFetchRequest

hashCode() - Method in class com.norconex.crawler.fs.fetch.FsPath

hashCode() - Method in class com.norconex.crawler.fs.fetch.impl.AbstractNioFetcher

hashCode() - Method in class com.norconex.crawler.fs.fetch.impl.adlsgen2.AdlsGen2Fetcher

hashCode() - Method in class com.norconex.crawler.fs.fetch.impl.adlsgen2.AdlsGen2FetcherConfig

hashCode() - Method in class com.norconex.crawler.fs.fetch.impl.archive.ArchiveFetcher

hashCode() - Method in class com.norconex.crawler.fs.fetch.impl.archive.ArchiveFetcherConfig

hashCode() - Method in class com.norconex.crawler.fs.fetch.impl.azureblob.AzureBlobFetcher

hashCode() - Method in class com.norconex.crawler.fs.fetch.impl.azureblob.AzureBlobFetcherConfig

hashCode() - Method in class com.norconex.crawler.fs.fetch.impl.BaseAuthNioFetcherConfig

hashCode() - Method in class com.norconex.crawler.fs.fetch.impl.box.BoxFetcher

hashCode() - Method in class com.norconex.crawler.fs.fetch.impl.box.BoxFetcherConfig

hashCode() - Method in class com.norconex.crawler.fs.fetch.impl.cmis.CmisAtomSession

hashCode() - Method in class com.norconex.crawler.fs.fetch.impl.cmis.CmisFetcher

hashCode() - Method in class com.norconex.crawler.fs.fetch.impl.cmis.CmisFetcherConfig

hashCode() - Method in class com.norconex.crawler.fs.fetch.impl.egnyte.EgnyteFetcher

hashCode() - Method in class com.norconex.crawler.fs.fetch.impl.egnyte.EgnyteFetcherConfig

hashCode() - Method in record class com.norconex.crawler.fs.fetch.impl.FolderItemReferenceParser.Parsed

Returns a hash code value for this object.

hashCode() - Method in class com.norconex.crawler.fs.fetch.impl.ftp.FtpFetcher

hashCode() - Method in class com.norconex.crawler.fs.fetch.impl.ftp.FtpFetcherConfig

hashCode() - Method in class com.norconex.crawler.fs.fetch.impl.gcs.GcsFetcher

hashCode() - Method in class com.norconex.crawler.fs.fetch.impl.gcs.GcsFetcherConfig

hashCode() - Method in class com.norconex.crawler.fs.fetch.impl.GenericFileFetchResponse

hashCode() - Method in class com.norconex.crawler.fs.fetch.impl.GenericFolderPathsFetchResponse

hashCode() - Method in class com.norconex.crawler.fs.fetch.impl.googledrive.GoogleDriveFetcher

hashCode() - Method in class com.norconex.crawler.fs.fetch.impl.googledrive.GoogleDriveFetcherConfig

hashCode() - Method in class com.norconex.crawler.fs.fetch.impl.hdfs.HdfsFetcher

hashCode() - Method in class com.norconex.crawler.fs.fetch.impl.hdfs.HdfsFetcherConfig

hashCode() - Method in class com.norconex.crawler.fs.fetch.impl.hdfs.KerberosConfig

hashCode() - Method in class com.norconex.crawler.fs.fetch.impl.local.LocalFetcher

hashCode() - Method in class com.norconex.crawler.fs.fetch.impl.local.LocalFetcherConfig

hashCode() - Method in class com.norconex.crawler.fs.fetch.impl.m365graph.M365GraphFetcher

hashCode() - Method in class com.norconex.crawler.fs.fetch.impl.m365graph.M365GraphFetcherConfig

hashCode() - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyPath

hashCode() - Method in class com.norconex.crawler.fs.fetch.impl.s3.S3Fetcher

hashCode() - Method in class com.norconex.crawler.fs.fetch.impl.s3.S3FetcherConfig

hashCode() - Method in class com.norconex.crawler.fs.fetch.impl.sftp.SftpFetcher

hashCode() - Method in class com.norconex.crawler.fs.fetch.impl.sftp.SftpFetcherConfig

hashCode() - Method in class com.norconex.crawler.fs.fetch.impl.smb.SmbFetcher

hashCode() - Method in class com.norconex.crawler.fs.fetch.impl.smb.SmbFetcherConfig

hashCode() - Method in class com.norconex.crawler.fs.fetch.impl.webdav.WebDavFetcher

hashCode() - Method in class com.norconex.crawler.fs.fetch.impl.webdav.WebDavFetcherConfig

hashCode() - Method in class com.norconex.crawler.fs.ledger.FsCrawlerEntry

hashCode() - Method in class com.norconex.crawler.web.doc.operations.canon.impl.GenericCanonicalLinkDetector

hashCode() - Method in class com.norconex.crawler.web.doc.operations.canon.impl.GenericCanonicalLinkDetectorConfig

hashCode() - Method in class com.norconex.crawler.web.doc.operations.checksum.impl.LastModifiedMetadataChecksummer

hashCode() - Method in class com.norconex.crawler.web.doc.operations.delay.impl.AbstractDelay

hashCode() - Method in class com.norconex.crawler.web.doc.operations.delay.impl.AbstractDelayResolver

hashCode() - Method in class com.norconex.crawler.web.doc.operations.delay.impl.BaseDelayResolverConfig

hashCode() - Method in class com.norconex.crawler.web.doc.operations.delay.impl.CrawlerDelay

hashCode() - Method in class com.norconex.crawler.web.doc.operations.delay.impl.DelayRange

hashCode() - Method in class com.norconex.crawler.web.doc.operations.delay.impl.DelayReferencePattern

hashCode() - Method in class com.norconex.crawler.web.doc.operations.delay.impl.DelaySchedule

hashCode() - Method in class com.norconex.crawler.web.doc.operations.delay.impl.GenericDelayResolver

hashCode() - Method in class com.norconex.crawler.web.doc.operations.delay.impl.GenericDelayResolverConfig

hashCode() - Method in class com.norconex.crawler.web.doc.operations.delay.impl.ReferenceDelayResolver

hashCode() - Method in class com.norconex.crawler.web.doc.operations.delay.impl.ReferenceDelayResolverConfig

hashCode() - Method in class com.norconex.crawler.web.doc.operations.delay.impl.SiteDelay

hashCode() - Method in class com.norconex.crawler.web.doc.operations.filter.impl.SegmentCountUrlFilter

hashCode() - Method in class com.norconex.crawler.web.doc.operations.filter.impl.SegmentCountUrlFilterConfig

hashCode() - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImage

hashCode() - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolver

hashCode() - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig

hashCode() - Method in class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractor

hashCode() - Method in class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractorConfig

hashCode() - Method in class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractorConfig.LinkSelector

hashCode() - Method in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractor

hashCode() - Method in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractorConfig

hashCode() - Method in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractorConfig.RegexPair

hashCode() - Method in class com.norconex.crawler.web.doc.operations.link.impl.RegexLinkExtractor

hashCode() - Method in class com.norconex.crawler.web.doc.operations.link.impl.RegexLinkExtractorConfig.ExtractionPattern

hashCode() - Method in class com.norconex.crawler.web.doc.operations.link.impl.RegexLinkExtractorConfig

hashCode() - Method in class com.norconex.crawler.web.doc.operations.link.impl.TikaLinkExtractor

hashCode() - Method in class com.norconex.crawler.web.doc.operations.link.impl.TikaLinkExtractorConfig

hashCode() - Method in class com.norconex.crawler.web.doc.operations.link.impl.XmlFeedLinkExtractor

hashCode() - Method in class com.norconex.crawler.web.doc.operations.link.impl.XmlFeedLinkExtractorConfig

hashCode() - Method in class com.norconex.crawler.web.doc.operations.link.Link

hashCode() - Method in class com.norconex.crawler.web.doc.operations.recrawl.impl.GenericRecrawlableResolver

hashCode() - Method in class com.norconex.crawler.web.doc.operations.recrawl.impl.GenericRecrawlableResolverConfig

hashCode() - Method in class com.norconex.crawler.web.doc.operations.recrawl.impl.GenericRecrawlableResolverConfig.MinFrequency

hashCode() - Method in class com.norconex.crawler.web.doc.operations.robot.impl.StandardRobotsMetaProvider

hashCode() - Method in class com.norconex.crawler.web.doc.operations.robot.impl.StandardRobotsMetaProviderConfig

hashCode() - Method in class com.norconex.crawler.web.doc.operations.robot.impl.StandardRobotsTxtProvider

hashCode() - Method in class com.norconex.crawler.web.doc.operations.robot.RobotsMeta

hashCode() - Method in class com.norconex.crawler.web.doc.operations.robot.RobotsTxt

hashCode() - Method in class com.norconex.crawler.web.doc.operations.scope.impl.GenericUrlScopeResolver

hashCode() - Method in class com.norconex.crawler.web.doc.operations.scope.impl.GenericUrlScopeResolverConfig

hashCode() - Method in class com.norconex.crawler.web.doc.operations.sitemap.impl.GenericSitemapLocator

hashCode() - Method in class com.norconex.crawler.web.doc.operations.sitemap.impl.GenericSitemapLocatorConfig

hashCode() - Method in class com.norconex.crawler.web.doc.operations.sitemap.impl.GenericSitemapResolver

hashCode() - Method in class com.norconex.crawler.web.doc.operations.sitemap.impl.GenericSitemapResolverConfig

hashCode() - Method in class com.norconex.crawler.web.doc.operations.sitemap.SitemapContext

hashCode() - Method in class com.norconex.crawler.web.doc.operations.sitemap.SitemapRecord

hashCode() - Method in class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizer

hashCode() - Method in class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizerConfig

hashCode() - Method in class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizerConfig.NormalizationReplace

hashCode() - Method in class com.norconex.crawler.web.doc.pipelines.importer.WebImporterPipelineContext

hashCode() - Method in class com.norconex.crawler.web.event.listeners.UrlStatusCrawlerEventListener

hashCode() - Method in class com.norconex.crawler.web.event.listeners.UrlStatusCrawlerEventListenerConfig

hashCode() - Method in class com.norconex.crawler.web.fetch.AggregatedWebFetchResponse

hashCode() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthConfig

hashCode() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcher

hashCode() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

hashCode() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetchResponse

hashCode() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.KerberosConfig

hashCode() - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcher

hashCode() - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcherConfig

hashCode() - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightScreenshotHandler

hashCode() - Method in class com.norconex.crawler.web.fetch.impl.webdriver.HttpSniffer

hashCode() - Method in class com.norconex.crawler.web.fetch.impl.webdriver.HttpSnifferConfig

hashCode() - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcher

hashCode() - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig

hashCode() - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverScreenshotHandler

hashCode() - Method in class com.norconex.crawler.web.fetch.util.AbstractScreenshotHandler

hashCode() - Method in class com.norconex.crawler.web.fetch.util.DocImageHandler

hashCode() - Method in class com.norconex.crawler.web.fetch.util.DocImageHandlerConfig

hashCode() - Method in class com.norconex.crawler.web.fetch.util.GenericRedirectUrlProvider

hashCode() - Method in class com.norconex.crawler.web.fetch.util.GenericRedirectUrlProviderConfig

hashCode() - Method in class com.norconex.crawler.web.fetch.util.ScreenshotHandlerConfig

hashCode() - Method in class com.norconex.crawler.web.fetch.WebFetchRequest

hashCode() - Method in class com.norconex.crawler.web.ledger.WebCrawlerEntry

hashCode() - Method in class com.norconex.crawler.web.WebCrawlerConfig

hashCode() - Method in class com.norconex.importer.charset.CharsetDetector.CharsetDetectorBuilder

hashCode() - Method in class com.norconex.importer.doc.Doc

hashCode() - Method in class com.norconex.importer.handler.BaseLabelableConfig

hashCode() - Method in class com.norconex.importer.handler.condition.AllOf

hashCode() - Method in class com.norconex.importer.handler.condition.AnyOf

hashCode() - Method in class com.norconex.importer.handler.condition.ConditionalDocHandler

hashCode() - Method in class com.norconex.importer.handler.condition.ConditionGroup

hashCode() - Method in class com.norconex.importer.handler.condition.impl.BlankCondition

hashCode() - Method in class com.norconex.importer.handler.condition.impl.BlankConditionConfig

hashCode() - Method in class com.norconex.importer.handler.condition.impl.DateCondition

hashCode() - Method in class com.norconex.importer.handler.condition.impl.DateConditionConfig

hashCode() - Method in class com.norconex.importer.handler.condition.impl.DateProviderFactory.DynamicFixedDateTimeProvider

hashCode() - Method in class com.norconex.importer.handler.condition.impl.DateProviderFactory.DynamicFloatingDateTimeProvider

hashCode() - Method in class com.norconex.importer.handler.condition.impl.DateProviderFactory.StaticDateTimeProvider

hashCode() - Method in class com.norconex.importer.handler.condition.impl.DateValueMatcher

hashCode() - Method in class com.norconex.importer.handler.condition.impl.DomCondition

hashCode() - Method in class com.norconex.importer.handler.condition.impl.DomConditionConfig

hashCode() - Method in class com.norconex.importer.handler.condition.impl.NumericCondition

hashCode() - Method in class com.norconex.importer.handler.condition.impl.NumericConditionConfig

hashCode() - Method in class com.norconex.importer.handler.condition.impl.NumericValueMatcher

hashCode() - Method in class com.norconex.importer.handler.condition.impl.ReferenceCondition

hashCode() - Method in class com.norconex.importer.handler.condition.impl.ReferenceConditionConfig

hashCode() - Method in class com.norconex.importer.handler.condition.impl.ScriptCondition

hashCode() - Method in class com.norconex.importer.handler.condition.impl.ScriptConditionConfig

hashCode() - Method in class com.norconex.importer.handler.condition.impl.TextCondition

hashCode() - Method in class com.norconex.importer.handler.condition.impl.TextConditionConfig

hashCode() - Method in class com.norconex.importer.handler.condition.NoneOf

hashCode() - Method in class com.norconex.importer.handler.DocHandlerContext

hashCode() - Method in class com.norconex.importer.handler.parser.impl.DefaultParser

hashCode() - Method in class com.norconex.importer.handler.parser.impl.DefaultParserConfig

hashCode() - Method in class com.norconex.importer.handler.parser.impl.EmbeddedConfig

hashCode() - Method in class com.norconex.importer.handler.parser.impl.ExternalParser

hashCode() - Method in class com.norconex.importer.handler.parser.impl.GrobidConfig

hashCode() - Method in class com.norconex.importer.handler.parser.impl.OcrConfig

hashCode() - Method in class com.norconex.importer.handler.parser.impl.SentimentConfig

hashCode() - Method in class com.norconex.importer.handler.parser.impl.TikaParser

hashCode() - Method in class com.norconex.importer.handler.parser.impl.TikaParserConfig

hashCode() - Method in class com.norconex.importer.handler.Reject

hashCode() - Method in class com.norconex.importer.handler.RejectConfig

hashCode() - Method in class com.norconex.importer.handler.ScriptRunner

hashCode() - Method in class com.norconex.importer.handler.splitter.AbstractDocumentSplitter

hashCode() - Method in class com.norconex.importer.handler.splitter.BaseDocumentSplitterConfig

hashCode() - Method in class com.norconex.importer.handler.splitter.impl.CsvSplitter

hashCode() - Method in class com.norconex.importer.handler.splitter.impl.CsvSplitterConfig

hashCode() - Method in class com.norconex.importer.handler.splitter.impl.DomSplitter

hashCode() - Method in class com.norconex.importer.handler.splitter.impl.DomSplitterConfig

hashCode() - Method in class com.norconex.importer.handler.splitter.impl.PdfPageSplitter

hashCode() - Method in class com.norconex.importer.handler.splitter.impl.PdfPageSplitterConfig

hashCode() - Method in class com.norconex.importer.handler.splitter.impl.TranslatorSplitter

hashCode() - Method in class com.norconex.importer.handler.splitter.impl.TranslatorSplitterConfig

hashCode() - Method in class com.norconex.importer.handler.splitter.impl.XmlStreamSplitter

hashCode() - Method in class com.norconex.importer.handler.splitter.impl.XmlStreamSplitterConfig

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.BinaryContentTransformer

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.BinaryContentTransformerConfig

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.CharacterCaseTransformer

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.CharacterCaseTransformerConfig

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.CharsetTransformer

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.CharsetTransformerConfig

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.CollapseRepeatingTransformer

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.CollapseRepeatingTransformerConfig

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.Constant

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.ConstantTransformer

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.ConstantTransformerConfig

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.CopyOperation

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.CopyTransformer

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.CopyTransformerConfig

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.CountMatchesTransformer

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.CountMatchesTransformerConfig

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.CurrentDateTransformer

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.CurrentDateTransformerConfig

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.DateFormatTransformer

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.DateFormatTransformerConfig

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.DebugTransformer

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.DebugTransformerConfig

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.DeleteTransformer

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.DeleteTransformerConfig

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.DocumentLengthTransformer

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.DocumentLengthTransformerConfig

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.DomOperation

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.DomTransformer

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.DomTransformerConfig

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.ExternalTransformer

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.ExternalTransformerConfig

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.FieldReportTransformer

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.FieldReportTransformerConfig

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.ForceSingleValueTransformer

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.ForceSingleValueTransformerConfig

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.HierarchyOperation

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.HierarchyTransformer

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.HierarchyTransformerConfig

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.ImageTransformer

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.ImageTransformerConfig.Crop

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.ImageTransformerConfig

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.ImageTransformerConfig.Scale

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.KeepOnlyTransformer

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.KeepOnlyTransformerConfig

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.LanguageTransformer

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.LanguageTransformerConfig

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.MergeOperation

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.MergeTransformer

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.MergeTransformerConfig

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.RegexTransformer

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.RegexTransformerConfig

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.RenameOperation

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.RenameTransformer

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.RenameTransformerConfig

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.ReplaceOperation

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.ReplaceTransformer

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.ReplaceTransformerConfig

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.SaveDocumentTransformer

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.SaveDocumentTransformerConfig

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.ScriptTransformer

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.ScriptTransformerConfig

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.SplitOperation

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.SplitTransformer

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.SplitTransformerConfig

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.StripAfterTransformer

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.StripAfterTransformerConfig

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.StripBeforeTransformer

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.StripBeforeTransformerConfig

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.StripBetweenOperation

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.StripBetweenTransformer

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.StripBetweenTransformerConfig

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.SubstringTransformer

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.SubstringTransformerConfig

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.TextBetweenOperation

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.TextBetweenTransformer

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.TextBetweenTransformerConfig

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.TextStatisticsTransformer

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.TextStatisticsTransformerConfig

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.TitleGeneratorTransformer

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.TitleGeneratorTransformerConfig

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.TruncateTransformer

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.TruncateTransformerConfig

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.UrlExtractorTransformer

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.UrlExtractorTransformerConfig

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.UuidTransformer

hashCode() - Method in class com.norconex.importer.handler.transformer.impl.UuidTransformerConfig

hashCode() - Method in class com.norconex.importer.Importer

hashCode() - Method in class com.norconex.importer.ImporterConfig

hashCode() - Method in class com.norconex.importer.ImporterEvent

hashCode() - Method in class com.norconex.importer.ImporterRequest

hashCode() - Method in class com.norconex.importer.response.ImporterResponse

hashCode() - Method in class com.norconex.importer.util.chunk.TextChunk

hashCode() - Method in class com.norconex.importer.util.ReadAdapter.ChunkedReadOptions

hasTimedOut(long) - Method in class com.norconex.crawler.core.cluster.pipeline.StepRecord

HazelcastCacheManager - Class in com.norconex.crawler.core.cluster.impl.hazelcast

HazelcastCacheManager(HazelcastInstance) - Constructor for class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastCacheManager

HazelcastCluster - Class in com.norconex.crawler.core.cluster.impl.hazelcast

HazelcastCluster(HazelcastClusterConnectorConfig) - Constructor for class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastCluster

HazelcastClusterConnector - Class in com.norconex.crawler.core.cluster.impl.hazelcast

HazelcastClusterConnector() - Constructor for class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastClusterConnector

HazelcastClusterConnectorConfig - Class in com.norconex.crawler.core.cluster.impl.hazelcast

HazelcastClusterConnectorConfig() - Constructor for class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastClusterConnectorConfig

HazelcastClusterNode - Class in com.norconex.crawler.core.cluster.impl.hazelcast

HazelcastClusterNode(HazelcastInstance, boolean) - Constructor for class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastClusterNode

HazelcastConfigLoader - Class in com.norconex.crawler.core.cluster.impl.hazelcast

HazelcastConfigurer - Interface in com.norconex.crawler.core.cluster.impl.hazelcast

Strategy interface for building a Hazelcast Config programmatically.

HazelcastConfigurerContext - Record Class in com.norconex.crawler.core.cluster.impl.hazelcast

Context passed to HazelcastConfigurer.buildConfig(HazelcastConfigurerContext) with all framework-supplied information needed to build the Hazelcast configuration.

HazelcastConfigurerContext(Path, boolean, String) - Constructor for record class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastConfigurerContext

Creates an instance of a HazelcastConfigurerContext record class.

HazelcastMapAdapter<T> - Class in com.norconex.crawler.core.cluster.impl.hazelcast

Hazelcast IMap-based implementation of the Cache interface.

HazelcastMapAdapter(IMap<String, ?>, HazelcastInstance, Class<T>) - Constructor for class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastMapAdapter

HazelcastPipelineManager - Class in com.norconex.crawler.core.cluster.impl.hazelcast.pipeline

HazelcastPipelineManager(HazelcastCluster) - Constructor for class com.norconex.crawler.core.cluster.impl.hazelcast.pipeline.HazelcastPipelineManager

HazelcastQueueAdapter<T> - Class in com.norconex.crawler.core.cluster.impl.hazelcast

HazelcastQueueAdapter(IQueue<Object>, HazelcastInstance, Class<T>) - Constructor for class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastQueueAdapter

HazelcastUtil - Class in com.norconex.crawler.core.cluster.impl.hazelcast

HdfsAuthMethod - Enum Class in com.norconex.crawler.fs.fetch.impl.hdfs

WebHDFS authentication methods.

HdfsFetcher - Class in com.norconex.crawler.fs.fetch.impl.hdfs

Fetcher for HDFS (webhdfs://), backed by a custom, read-only NIO.2 FileSystemProvider (HdfsFileSystemProvider) that speaks the WebHDFS REST API directly over Apache HttpClient - no Hadoop client dependency.

HdfsFetcher() - Constructor for class com.norconex.crawler.fs.fetch.impl.hdfs.HdfsFetcher

HdfsFetcherConfig - Class in com.norconex.crawler.fs.fetch.impl.hdfs

Configuration for HdfsFetcher.

HdfsFetcherConfig() - Constructor for class com.norconex.crawler.fs.fetch.impl.hdfs.HdfsFetcherConfig

HEAD - Enum constant in enum class com.norconex.crawler.web.fetch.HttpMethod

header - Static variable in class com.norconex.committer.core.fs.impl.CsvColumn.Fields

HEADER_REQUEST_ID - Static variable in class com.norconex.crawler.web.fetch.impl.webdriver.HttpSniffer

HierarchyOperation - Class in com.norconex.importer.handler.transformer.impl

HierarchyOperation() - Constructor for class com.norconex.importer.handler.transformer.impl.HierarchyOperation

HierarchyTransformer - Class in com.norconex.importer.handler.transformer.impl

Given a separator, split a field string into multiple segments representing each node of a hierarchical branch.

HierarchyTransformer() - Constructor for class com.norconex.importer.handler.transformer.impl.HierarchyTransformer

HierarchyTransformerConfig - Class in com.norconex.importer.handler.transformer.impl

Given a separator, split a field string into multiple segments representing each node of a hierarchical branch.

HierarchyTransformerConfig() - Constructor for class com.norconex.importer.handler.transformer.impl.HierarchyTransformerConfig

HIGH - Enum constant in enum class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig.Quality

host - Static variable in class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthConfig.Fields

host() - Method in record class com.norconex.crawler.fs.fetch.impl.FolderItemReferenceParser.Parsed

Returns the value of the host record component.

HOUR - Enum constant in enum class com.norconex.importer.handler.condition.impl.DateCondition.TimeUnit

HOURLY - Enum constant in enum class com.norconex.crawler.web.doc.operations.sitemap.SitemapChangeFrequency

How to create a condition with scripting: - Search tag in class com.norconex.importer.handler.condition.impl.ScriptCondition

Section

How to create a condition with scripting: - Search tag in class com.norconex.importer.handler.condition.impl.ScriptConditionConfig

Section

How to transform documents with scripting: - Search tag in class com.norconex.importer.handler.transformer.impl.ScriptTransformer

Section

How to transform documents with scripting: - Search tag in class com.norconex.importer.handler.transformer.impl.ScriptTransformerConfig

Section

HstsResolver - Class in com.norconex.crawler.web.fetch.util

Class handling HSTS support for servers supporting it.

HSTS Support - Search tag in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcher

Section

HTML - Enum constant in enum class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.StructuredDataType

HTML_CONTENT_TYPES - Static variable in class com.norconex.importer.handler.CommonMatchers

HTML/XHTML content types:

HTML/XML Comments - Search tag in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractor

Section

htmlContentTypes() - Static method in class com.norconex.importer.handler.CommonMatchers

Matcher for common content-types defining an HTML or XHTML document.

htmlContentTypes(String) - Static method in class com.norconex.importer.handler.CommonRestrictions

Default content-types defining an HTML or XHTML document.

HtmlLinkExtractor - Class in com.norconex.crawler.web.doc.operations.link.impl

A memory efficient HTML link extractor.

HtmlLinkExtractor() - Constructor for class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractor

HtmlLinkExtractorConfig - Class in com.norconex.crawler.web.doc.operations.link.impl

Configuration for HtmlLinkExtractor.

HtmlLinkExtractorConfig() - Constructor for class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractorConfig

HtmlLinkExtractorConfig.RegexPair - Class in com.norconex.crawler.web.doc.operations.link.impl

HTTP - Enum constant in enum class com.norconex.committer.solr.SolrClientType

Deprecated.

use SolrClientType.HTTP2 instead.

HTTP_EQUIV - Static variable in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractorConfig

HTTP_JDK - Enum constant in enum class com.norconex.committer.solr.SolrClientType

A client using the JDK’s built-in Http Client.

HTTP_STATUS_CODE - Static variable in class com.norconex.crawler.web.doc.WebDocMetadata

HTTP_STATUS_REASON - Static variable in class com.norconex.crawler.web.doc.WebDocMetadata

HTTP2 - Enum constant in enum class com.norconex.committer.solr.SolrClientType

For direct access to a single Solr node using the HTTP/2 protocol (via Jetty).

HttpAuthConfig - Class in com.norconex.crawler.web.fetch.impl.httpclient

Generic HTTP Fetcher authentication configuration.

HttpAuthConfig() - Constructor for class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthConfig

HttpAuthConfig.Fields - Class in com.norconex.crawler.web.fetch.impl.httpclient

HttpAuthMethod - Enum Class in com.norconex.crawler.web.fetch.impl.httpclient

Authentication methods.

HttpClientFetcher - Class in com.norconex.crawler.web.fetch.impl.httpclient

Default web crawler implementation of Fetcher, based on Apache HttpClient.

HttpClientFetcher() - Constructor for class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcher

HttpClientFetcherConfig - Class in com.norconex.crawler.web.fetch.impl.httpclient

Generic HTTP Fetcher configuration.

HttpClientFetcherConfig() - Constructor for class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

HttpClientFetcherConfig.CookieSpec - Enum Class in com.norconex.crawler.web.fetch.impl.httpclient

HttpClientFetchResponse - Class in com.norconex.crawler.web.fetch.impl.httpclient

HTTP response information obtained from fetching a document.

HttpClientFetchResponse.HttpClientFetchResponseBuilder - Class in com.norconex.crawler.web.fetch.impl.httpclient

HTTP Fetcher - Search tag in class com.norconex.crawler.web.WebCrawlerConfig

Section

HttpFetchStage - Class in com.norconex.crawler.web.doc.pipelines.importer.stages

Fetches (i.e. download for processing) a document and/or its metadata (HTTP response headers) depending on supplied HttpMethod.

HttpFetchStage(FetchDirective) - Constructor for class com.norconex.crawler.web.doc.pipelines.importer.stages.HttpFetchStage

HTTP Headers - Search tag in class com.norconex.crawler.web.doc.operations.canon.impl.GenericCanonicalLinkDetector

Section

HTTP Headers - Search tag in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcher

Section

HTTP Headers - Search tag in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcher

Section

HttpMethod - Enum Class in com.norconex.crawler.web.fetch

HTTP Methods - Search tag in class com.norconex.crawler.web.WebCrawlerConfig

Section

HttpSniffer - Class in com.norconex.crawler.web.fetch.impl.webdriver

Used to set and capture HTTP request/response headers, when enabled.

HttpSniffer() - Constructor for class com.norconex.crawler.web.fetch.impl.webdriver.HttpSniffer

HttpSnifferConfig - Class in com.norconex.crawler.web.fetch.impl.webdriver

Configuration for HttpSniffer.

HttpSnifferConfig() - Constructor for class com.norconex.crawler.web.fetch.impl.webdriver.HttpSnifferConfig

hypen() - Method in class com.norconex.crawler.core.util.StringSanitizer.Builder

I

id - Static variable in class com.norconex.crawler.core.CrawlerConfig.Fields

ID - Enum constant in enum class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcherConfig.WaitElementType

Locate by element id attribute.

ID - Enum constant in enum class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig.WaitElementType

idleTimeout - Static variable in class com.norconex.crawler.core.CrawlerConfig.Fields

IdolCommitter - Class in com.norconex.committer.idol

Commits documents to IDOL Server/DIH or Connector Framework Server (CFS).

IdolCommitter() - Constructor for class com.norconex.committer.idol.IdolCommitter

IdolCommitterConfig - Class in com.norconex.committer.idol

IDOL Committer configuration.

IdolCommitterConfig() - Constructor for class com.norconex.committer.idol.IdolCommitterConfig

IdolCommitterPtProvider - Class in com.norconex.committer.idol.spi

For auto registering in BeanMapper.

IdolCommitterPtProvider() - Constructor for class com.norconex.committer.idol.spi.IdolCommitterPtProvider

If - Class in com.norconex.importer.handler.condition

If() - Constructor for class com.norconex.importer.handler.condition.If

If(Condition) - Constructor for class com.norconex.importer.handler.condition.If

IfNot - Class in com.norconex.importer.handler.condition

IfNot() - Constructor for class com.norconex.importer.handler.condition.IfNot

IfNot(Condition) - Constructor for class com.norconex.importer.handler.condition.IfNot

IGNORE - Enum constant in enum class com.norconex.crawler.core.CrawlerConfig.OrphansStrategy

Ignoring orphans effectively does nothing with them (not deleted, not processed).

IGNORE - Enum constant in enum class com.norconex.crawler.core.doc.operations.spoil.SpoiledReferenceStrategy

Ignoring spoiled references does not send a deletion request to the Committer.

IGNORE - Enum constant in enum class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig.CookieSpec

Ignoring link data - Search tag in class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractor

Section

Ignoring link data - Search tag in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractor

Section

IMAGE_IO_CONTENT_TYPES - Static variable in class com.norconex.importer.handler.CommonMatchers

Content types for natively supported Java ImageIO images.

ImageCache - Class in com.norconex.crawler.web.doc.operations.image.impl

Thread-safe, in-memory LRU cache for featured images, keyed by image URL.

ImageCache(int) - Constructor for class com.norconex.crawler.web.doc.operations.image.impl.ImageCache

Creates a new in-memory image cache with the given maximum number of entries.

Image dimension format - Search tag in class com.norconex.importer.handler.transformer.impl.ImageTransformer

Section

Image dimension format - Search tag in class com.norconex.importer.handler.transformer.impl.ImageTransformerConfig

Section

imageIOStandardContentTypes() - Static method in class com.norconex.importer.handler.CommonMatchers

Content types of standard image format supported by all Java ImageIO implementations: JPEG, PNG, GIF, BMP, WBMP.

imageIOStandardContentTypes(String) - Static method in class com.norconex.importer.handler.CommonRestrictions

Content types of standard image format supported by all Java ImageIO implementations: JPEG, PNG, GIF, BMP, WBMP.

imageMagickPath - Static variable in class com.norconex.importer.handler.parser.impl.OcrConfig.Fields

ImageTransformer - Class in com.norconex.importer.handler.transformer.impl

Transforms an image using common image operations.

ImageTransformer() - Constructor for class com.norconex.importer.handler.transformer.impl.ImageTransformer

ImageTransformerConfig - Class in com.norconex.importer.handler.transformer.impl

Transforms an image using common image operations.

ImageTransformerConfig() - Constructor for class com.norconex.importer.handler.transformer.impl.ImageTransformerConfig

ImageTransformerConfig.Crop - Class in com.norconex.importer.handler.transformer.impl

ImageTransformerConfig.Scale - Class in com.norconex.importer.handler.transformer.impl

importCaches(List<SerializedCache>) - Method in interface com.norconex.crawler.core.cluster.CacheManager

Import caches previously exported with CacheManager.exportCaches(Consumer).

importCaches(List<SerializedCache>) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastCacheManager

importCaches(List<SerializedCache>) - Method in class com.norconex.crawler.core.cluster.impl.memory.MemoryCacheManager

importCaches(List<SerializedCache>) - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheManager

importDocument(Doc) - Method in class com.norconex.importer.Importer

Imports a document according to the importer configuration.

importDocument(ImporterRequest) - Method in class com.norconex.importer.Importer

Imports a document according to the importer configuration.

IMPORTED_DATE - Static variable in class com.norconex.importer.doc.DocMetaConstants

Date processed by the Importer.

importer(Importer) - Method in class com.norconex.crawler.core.context.CrawlerContext.Builder

Importer - Class in com.norconex.importer

Principal class responsible for importing documents.

Importer() - Constructor for class com.norconex.importer.Importer

Creates a new importer with default configuration.

Importer(ImporterConfig) - Constructor for class com.norconex.importer.Importer

Creates a new importer with the given configuration.

Importer(ImporterConfig, EventManager) - Constructor for class com.norconex.importer.Importer

Creates a new importer with the given configuration.

IMPORTER_HANDLER_BEGIN - Static variable in class com.norconex.importer.ImporterEvent

IMPORTER_HANDLER_CONDITION_FALSE - Static variable in class com.norconex.importer.ImporterEvent

IMPORTER_HANDLER_CONDITION_TRUE - Static variable in class com.norconex.importer.ImporterEvent

IMPORTER_HANDLER_END - Static variable in class com.norconex.importer.ImporterEvent

IMPORTER_HANDLER_ERROR - Static variable in class com.norconex.importer.ImporterEvent

IMPORTER_INIT_BEGIN - Static variable in class com.norconex.importer.ImporterEvent

IMPORTER_INIT_END - Static variable in class com.norconex.importer.ImporterEvent

IMPORTER_PARSER_BEGIN - Static variable in class com.norconex.importer.ImporterEvent

IMPORTER_PARSER_END - Static variable in class com.norconex.importer.ImporterEvent

IMPORTER_PARSER_ERROR - Static variable in class com.norconex.importer.ImporterEvent

importerConfig - Static variable in class com.norconex.crawler.core.CrawlerConfig.Fields

ImporterConfig - Class in com.norconex.importer

Importer configuration.

ImporterConfig() - Constructor for class com.norconex.importer.ImporterConfig

ImporterEvent - Class in com.norconex.importer

An Importer event.

ImporterEvent(ImporterEvent.ImporterEventBuilder<?, ?>) - Constructor for class com.norconex.importer.ImporterEvent

ImporterEvent.ImporterEventBuilder<C,B> - Class in com.norconex.importer

ImporterEventBuilder() - Constructor for class com.norconex.importer.ImporterEvent.ImporterEventBuilder

ImporterException - Exception Class in com.norconex.importer

Exception thrown when an issue prevented the proper importation of a file.

ImporterException() - Constructor for exception class com.norconex.importer.ImporterException

ImporterException(String) - Constructor for exception class com.norconex.importer.ImporterException

ImporterException(String, Throwable) - Constructor for exception class com.norconex.importer.ImporterException

ImporterException(Throwable) - Constructor for exception class com.norconex.importer.ImporterException

ImporterLauncher - Class in com.norconex.importer

Command line launcher of the Importer application.

importerPipeline(ImporterPipeline) - Method in class com.norconex.crawler.core.doc.pipelines.CrawlerDocPipelines.CrawlerDocPipelinesBuilder

ImporterPipeline - Class in com.norconex.crawler.core.doc.pipelines.importer

ImporterPipeline.ImporterPipelineBuilder - Class in com.norconex.crawler.core.doc.pipelines.importer

ImporterPipelineContext - Class in com.norconex.crawler.core.doc.pipelines.importer

A context object for crawler pipelines dealing with ImporterResponse.

ImporterPipelineContext(CrawlerSession, CrawlerDocContext) - Constructor for class com.norconex.crawler.core.doc.pipelines.importer.ImporterPipelineContext

ImporterPtProvider - Class in com.norconex.importer.spi

For auto registering in BeanMapper.

ImporterPtProvider() - Constructor for class com.norconex.importer.spi.ImporterPtProvider

ImporterRequest - Class in com.norconex.importer

An Importer request, unique for each document to be imported.

ImporterRequest(InputStream) - Constructor for class com.norconex.importer.ImporterRequest

ImporterRequest(Path) - Constructor for class com.norconex.importer.ImporterRequest

ImporterResponse - Class in com.norconex.importer.response

ImporterResponse(Doc) - Constructor for class com.norconex.importer.response.ImporterResponse

ImporterResponse(String, ImporterResponse.Status) - Constructor for class com.norconex.importer.response.ImporterResponse

ImporterResponse.Status - Enum Class in com.norconex.importer.response

ImporterResponseProcessor - Interface in com.norconex.importer.response

Processes an importer response to modify it or perform other actions as required before it is returned.

ImporterRuntimeException - Exception Class in com.norconex.importer

RuntimeException thrown when a an issue prevented the proper importation of a file.

ImporterRuntimeException() - Constructor for exception class com.norconex.importer.ImporterRuntimeException

ImporterRuntimeException(String) - Constructor for exception class com.norconex.importer.ImporterRuntimeException

ImporterRuntimeException(String, Throwable) - Constructor for exception class com.norconex.importer.ImporterRuntimeException

ImporterRuntimeException(Throwable) - Constructor for exception class com.norconex.importer.ImporterRuntimeException

ImportModuleStage - Class in com.norconex.crawler.core.doc.pipelines.importer.stages

Common pipeline stage for importing documents.

ImportModuleStage() - Constructor for class com.norconex.crawler.core.doc.pipelines.importer.stages.ImportModuleStage

in() - Static method in class com.norconex.crawler.web.doc.operations.scope.UrlScope

INCLUDE - Enum constant in enum class com.norconex.crawler.core.doc.operations.filter.OnMatch

INCLUDE_CHILD_DRIVES - Enum constant in enum class com.norconex.crawler.fs.fetch.impl.m365graph.M365GraphFetcherConfig.SourceDeltaExpansion

Expand broader start references such as site, site URL, or user into child drives and maintain one delta cursor per drive.

includeIfNull(OnMatch) - Static method in enum class com.norconex.crawler.core.doc.operations.filter.OnMatch

INCREMENTAL - Enum constant in enum class com.norconex.crawler.core.session.CrawlerMode

Crawl taking into account previously crawled documents and only commit those that have been added, removed, or modified.

incrementAndGet() - Method in interface com.norconex.crawler.core.cluster.Counter

incrementCounter(String, long) - Method in class com.norconex.crawler.core.metrics.CrawlerMetricsImpl

indent - Static variable in class com.norconex.committer.core.fs.impl.JsonFileCommitterConfig.Fields

indent - Static variable in class com.norconex.committer.core.fs.impl.XmlFileCommitterConfig.Fields

INFO - Enum constant in enum class com.norconex.committer.core.impl.LogCommitterConfig.LogLevel

INFORMIX_UNLOAD_CSV1_3 - Enum constant in enum class com.norconex.committer.core.fs.impl.CsvFileCommitterConfig.CsvFormat

INFORMIX_UNLOAD1_3 - Enum constant in enum class com.norconex.committer.core.fs.impl.CsvFileCommitterConfig.CsvFormat

init() - Method in interface com.norconex.importer.handler.DocHandler

Initialize any required resources.

init() - Method in class com.norconex.importer.handler.parser.impl.DefaultParser

init() - Method in class com.norconex.importer.handler.parser.impl.TikaParser

init() - Method in class com.norconex.importer.Importer

Initializes the importer.

init(HazelcastInstance, Properties, String) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.jdbc.StringJdbcMapStore

init(CommitterContext) - Method in class com.norconex.committer.core.AbstractCommitter

init(CommitterContext) - Method in interface com.norconex.committer.core.Committer

Initializes this committer.

init(CommitterContext) - Method in class com.norconex.committer.core.service.CommitterService

init(CommitterContext, BatchConsumer) - Method in class com.norconex.committer.core.batch.queue.impl.FsQueue

init(CommitterContext, BatchConsumer) - Method in interface com.norconex.committer.core.batch.queue.CommitterQueue

Initializes the committer queue.

init(CrawlerSession) - Method in class com.norconex.crawler.core.context.CrawlerContext

init(CrawlerSession) - Method in class com.norconex.crawler.core.doc.pipelines.DedupService

init(CrawlerSession) - Method in class com.norconex.crawler.core.ledger.CrawlerEntryLedger

init(CrawlerSession) - Method in interface com.norconex.crawler.core.metrics.CrawlerMetrics

init(CrawlerSession) - Method in class com.norconex.crawler.core.metrics.CrawlerMetricsImpl

init(Path, boolean) - Method in interface com.norconex.crawler.core.cluster.Cluster

Convenience overload for tests and simple scenarios that do not need to pre-register cache value types.

init(Path, boolean, Map<String, Class<?>>) - Method in interface com.norconex.crawler.core.cluster.Cluster

init(Path, boolean, Map<String, Class<?>>) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastCluster

init(Path, boolean, Map<String, Class<?>>) - Method in class com.norconex.crawler.core.cluster.impl.memory.MemoryCluster

init(Path, boolean, Map<String, Class<?>>) - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCluster

initBatchCommitter() - Method in class com.norconex.committer.amazoncloudsearch.AmazonCloudSearchCommitter

initBatchCommitter() - Method in class com.norconex.committer.apachekafka.ApacheKafkaCommitter

initBatchCommitter() - Method in class com.norconex.committer.azurecognitivesearch.AzureSearchCommitter

initBatchCommitter() - Method in class com.norconex.committer.core.batch.AbstractBatchCommitter

Subclasses can perform additional initialization by overriding this method.

initBatchCommitter() - Method in class com.norconex.committer.elasticsearch.ElasticsearchCommitter

initBatchCommitter() - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitter

initBatchCommitter() - Method in class com.norconex.committer.idol.IdolCommitter

initBatchCommitter() - Method in class com.norconex.committer.neo4j.Neo4jCommitter

initBatchCommitter() - Method in class com.norconex.committer.solr.SolrCommitter

initBatchCommitter() - Method in class com.norconex.committer.sql.SqlCommitter

INLINE - Enum constant in enum class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig.Storage

Stores a Base64 string of the scaled image, in the format specified, in a "crawler.featured-image-inline" metadata field.

InMemoryCacheMap<T> - Class in com.norconex.crawler.core.cluster.impl.memory

In-memory CacheMap backed by a ConcurrentHashMap.

InMemoryCacheMap(String) - Constructor for class com.norconex.crawler.core.cluster.impl.memory.InMemoryCacheMap

InMemoryCacheQueue<T> - Class in com.norconex.crawler.core.cluster.impl.memory

In-memory CacheQueue backed by a ConcurrentLinkedQueue.

InMemoryCacheQueue(String) - Constructor for class com.norconex.crawler.core.cluster.impl.memory.InMemoryCacheQueue

InMemoryCacheSet - Class in com.norconex.crawler.core.cluster.impl.memory

In-memory CacheSet backed by a concurrent hash set.

InMemoryCacheSet() - Constructor for class com.norconex.crawler.core.cluster.impl.memory.InMemoryCacheSet

input() - Method in class com.norconex.importer.handler.DocHandlerContext

Flushes any output and returns an adapter for the document input..

INSCOPE - Enum constant in enum class com.norconex.crawler.web.WebCrawlerConfig.ReferencedLinkType

INTEGER - Enum constant in enum class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.StructuredDataType

is(PipelineStatus) - Method in enum class com.norconex.crawler.core.cluster.pipeline.PipelineStatus

is(FetchDirective) - Method in enum class com.norconex.crawler.core.fetch.FetchDirective

is(FetchDirectiveSupport) - Method in enum class com.norconex.crawler.core.fetch.FetchDirectiveSupport

is(ProcessingStatus) - Method in enum class com.norconex.crawler.core.ledger.ProcessingStatus

is(HttpMethod) - Method in enum class com.norconex.crawler.web.fetch.HttpMethod

IS_DOC_NEW - Static variable in class com.norconex.crawler.core.doc.CrawlerDocMetaConstants

Boolean flag indicating whether a document is new to the crawler that fetched it.

isAbsolute() - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyPath

isAccepted() - Method in class com.norconex.crawler.core.doc.pipelines.OnMatchFiltersResolver

isAclDisabled() - Method in class com.norconex.crawler.fs.fetch.impl.adlsgen2.AdlsGen2FetcherConfig

Whether ACL, owner, and group metadata extraction is disabled.

isAclDisabled() - Method in class com.norconex.crawler.fs.fetch.impl.cmis.CmisFetcherConfig

isAclDisabled() - Method in class com.norconex.crawler.fs.fetch.impl.local.LocalFetcherConfig

isAclDisabled() - Method in class com.norconex.crawler.fs.fetch.impl.smb.SmbFetcherConfig

isAdminDisabled() - Method in class com.norconex.crawler.core.cluster.ClusterConfig

Disable launching the crawler administrative server endpoints.

isAny(HttpMethod...) - Method in enum class com.norconex.crawler.web.fetch.HttpMethod

isAppendHash() - Method in class com.norconex.importer.handler.transformer.impl.TruncateTransformerConfig

Whether to apply the original string hash code at the end of the truncation to help ensure uniqueness (no guarantee).

isArrayFieldsRegex() - Method in class com.norconex.committer.azurecognitivesearch.AzureSearchCommitterConfig

Whether the list of fields to be always treated as array is represented as regular expression.

isAutodetectUtf8() - Method in class com.norconex.crawler.fs.fetch.impl.ftp.FtpFetcherConfig

isAutoDiscoveryEnabled() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.JdbcHazelcastConfigurer

Whether to use Hazelcast auto-discovery in clustered mode.

isCfs() - Method in class com.norconex.committer.idol.IdolCommitterConfig

Whether the IDOL index URL points to a Connector Framework Server (CFS).

isClosed() - Method in class com.norconex.committer.core.impl.MemoryCommitter

isClosed() - Method in class com.norconex.crawler.core.metrics.CrawlerMetricsImpl

isClosed() - Method in class com.norconex.crawler.core.session.CrawlerSession

isClustered() - Method in class com.norconex.crawler.core.cluster.ClusterConfig

Whether the crawler should run in stand-alone or cluster mode.

isClustered() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastCluster

isClusterRunning(HazelcastCluster) - Static method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastUtil

isCombineFieldsAndContent() - Method in class com.norconex.crawler.core.doc.operations.checksum.impl.Md5DocumentChecksummerConfig

Whether we are combining the fields and content checksums.

isComleted() - Method in enum class com.norconex.crawler.core.cluster.pipeline.PipelineStatus

isCommentsEnabled() - Method in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractorConfig

Gets whether links should be extracted from comments.

isCommitLeftoversOnInit() - Method in class com.norconex.committer.core.batch.queue.impl.FsQueueConfig

During initialization, whether to attempt committing any leftover files in the committer queue from a previous crawl session.

isCompress() - Method in class com.norconex.committer.core.fs.BaseFsCommitterConfig

isCoordinator() - Method in interface com.norconex.crawler.core.cluster.ClusterNode

isCoordinator() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastClusterNode

isCreateTopic() - Method in class com.norconex.committer.apachekafka.ApacheKafkaCommitterConfig

Whether to create the topic in Apache Kafka.

isDelete() - Method in class com.norconex.crawler.core.doc.pipelines.importer.ImporterPipelineContext

isDelete() - Method in class com.norconex.importer.handler.transformer.impl.DomOperation

The gets whether to delete DOM attributes/elements matching the specified selector.

isDeleted() - Method in class com.norconex.crawler.core.ledger.CrawlerEntry

isDeleteFromFields() - Method in class com.norconex.importer.handler.transformer.impl.MergeOperation

isDetectHeading() - Method in class com.norconex.importer.handler.transformer.impl.TitleGeneratorTransformerConfig

isDirectory() - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyFileAttributes

isDisabled() - Method in class com.norconex.importer.handler.parser.impl.OcrConfig

isDisableDocKeyEncoding() - Method in class com.norconex.committer.azurecognitivesearch.AzureSearchCommitterConfig

Whether to disable document reference encoding.

isDiscardOriginal() - Method in class com.norconex.importer.handler.splitter.BaseDocumentSplitterConfig

Whether to discard the original document after it was split.

isDiscardUnchanged() - Method in class com.norconex.importer.handler.transformer.impl.ReplaceOperation

isDiscoverNodes() - Method in class com.norconex.committer.elasticsearch.ElasticsearchCommitterConfig

Whether automatic discovery of Elasticsearch cluster nodes should be enabled.

isDistributed() - Method in class com.norconex.crawler.core.cluster.pipeline.BaseStep

isDistributed() - Method in interface com.norconex.crawler.core.cluster.pipeline.Step

isDocumentDeduplicate() - Method in class com.norconex.crawler.core.CrawlerConfig

Whether to turn ON deduplication based on document checksum.

isDuplicate() - Method in class com.norconex.crawler.web.doc.operations.filter.impl.SegmentCountUrlFilterConfig

Whether the configured segment count represents the number of duplicated segments for this filter to be considered a match.

isEmpty() - Method in interface com.norconex.crawler.core.cluster.CacheMap

isEmpty() - Method in interface com.norconex.crawler.core.cluster.CacheQueue

isEmpty() - Method in interface com.norconex.crawler.core.cluster.CacheSet

isEmpty() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastMapAdapter

isEmpty() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastQueueAdapter

isEmpty() - Method in class com.norconex.crawler.core.cluster.impl.memory.InMemoryCacheMap

isEmpty() - Method in class com.norconex.crawler.core.cluster.impl.memory.InMemoryCacheQueue

isEmpty() - Method in class com.norconex.crawler.core.cluster.impl.memory.InMemoryCacheSet

isEmpty() - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheMap

isEmpty() - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheQueue

isEmpty() - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheSet

isEmpty() - Method in class com.norconex.crawler.web.doc.operations.robot.RobotsTxt

isEmpty(Path) - Static method in class com.norconex.committer.core.batch.queue.impl.FSQueueUtil

Recursively gets whether a queue directory is empty of queue files.

isEnabled() - Method in class com.norconex.importer.handler.parser.impl.GrobidConfig

isEnabled() - Method in class com.norconex.importer.handler.parser.impl.SentimentConfig

isEnabled(FetchDirectiveSupport) - Static method in enum class com.norconex.crawler.core.fetch.FetchDirectiveSupport

isError() - Method in class com.norconex.importer.response.ImporterResponse

isEscape() - Method in class com.norconex.importer.handler.transformer.impl.SaveDocumentTransformerConfig

isETagDisabled() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

Whether adding "ETag" If-None-Match HTTP request header is disabled.

isExpectContinueEnabled() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

Whether 'Expect: 100-continue' handshake is enabled.

isFailed() - Method in enum class com.norconex.crawler.core.cluster.pipeline.PipelineStatus

isFailOnDeleteNotFound() - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig

Whether a delete request targeting an item that does not exist in the index is treated as a failure.

isFetchDirectiveEnabled(FetchDirective) - Method in class com.norconex.crawler.core.doc.pipelines.importer.ImporterPipelineContext

Whether a fetch directive has been enabled according to configuration.

isFile() - Method in class com.norconex.crawler.fs.fetch.AggregatedFileFetchResponse

isFile() - Method in interface com.norconex.crawler.fs.fetch.FileFetchResponse

Whether the fetched path is a file.

isFile() - Method in class com.norconex.crawler.fs.fetch.FsPath

isFile() - Method in class com.norconex.crawler.fs.fetch.impl.GenericFileFetchResponse

isFile() - Method in class com.norconex.crawler.fs.ledger.FsCrawlerEntry

isFixBadIds() - Method in class com.norconex.committer.amazoncloudsearch.AmazonCloudSearchCommitterConfig

Whether to fix IDs that are too long for CloudSearch ID limitation (128 characters max).

isFixBadIds() - Method in class com.norconex.committer.elasticsearch.ElasticsearchCommitterConfig

Whether to fix IDs that are too long for Elasticsearch ID limitation (512 bytes max).

isFixFieldNames() - Method in class com.norconex.committer.sql.SqlCommitterConfig

Whether to attempt preventing insertion errors by converting characters that are not underscores or alphanumeric to underscores.

isFixFieldValues() - Method in class com.norconex.committer.sql.SqlCommitterConfig

Attempts to prevent insertion errors by truncating values that are larger than their defined maximum field length.

isFolder() - Method in class com.norconex.crawler.fs.fetch.AggregatedFileFetchResponse

isFolder() - Method in interface com.norconex.crawler.fs.fetch.FileFetchResponse

Whether the fetched path a folder.

isFolder() - Method in class com.norconex.crawler.fs.fetch.FsPath

isFolder() - Method in class com.norconex.crawler.fs.fetch.impl.GenericFileFetchResponse

isFolder() - Method in class com.norconex.crawler.fs.ledger.FsCrawlerEntry

isFollowRedirect() - Method in class com.norconex.crawler.fs.fetch.impl.webdav.WebDavFetcherConfig

isForceCharsetDetection() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

Whether character encoding is detected instead of relying on the charset sometimes found in the Content-Type HTTP response header.

isForceContentTypeDetection() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

Whether content type is detected instead of relying on returned Content-Type HTTP response header.

isForcePathStyle() - Method in class com.norconex.crawler.fs.fetch.impl.s3.S3FetcherConfig

Whether to use path-style bucket addressing (endpoint/bucket/key) instead of the AWS-default virtual-hosted style (bucket.endpoint/key).

isFromSitemap() - Method in class com.norconex.crawler.web.ledger.WebCrawlerEntry

Whether this record was obtained from parsing a sitemap.

isGoodState() - Method in class com.norconex.crawler.core.ledger.ProcessingOutcome

Returns whether a reference should be considered "good" (the corresponding document is not in a "bad" state, such as being rejected or produced an error.

isGoodState(ProcessingOutcome) - Static method in class com.norconex.crawler.core.ledger.ProcessingOutcome

Null-safe version of ProcessingOutcome.isGoodState().

isHeadless() - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcherConfig

Whether to run the browser in headless mode.

isHidden(Path) - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyFileSystemProvider

isHostnameVerificationEnabled() - Method in class com.norconex.crawler.fs.fetch.impl.webdav.WebDavFetcherConfig

isHstsDisabled() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

Gets whether the forcing of non secure URLs to secure ones is disabled, according to the URL domain Strict-Transport-Security policy (obtained from HTTP response header).

isIfModifiedSinceDisabled() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

Whether adding the If-Modified-Since HTTP request header is disabled.

isIgnoreCase() - Method in class com.norconex.crawler.core.doc.operations.filter.impl.ExtensionReferenceFilterConfig

isIgnoreCase() - Method in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractorConfig.RegexPair

isIgnoreCase() - Method in class com.norconex.importer.handler.transformer.impl.CollapseRepeatingTransformerConfig

Gets whether to ignore case sensitivity.

isIgnoreContent() - Method in class com.norconex.committer.core.impl.LogCommitterConfig

isIgnoreContent() - Method in class com.norconex.committer.core.impl.MemoryCommitterConfig

isIgnoreErrors() - Method in class com.norconex.committer.core.batch.queue.impl.FsQueueConfig.OnCommitFailure

Whether to ignore non-critical errors in an attempt to keep going.

isIgnoreHttpsErrors() - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcherConfig

When true, HTTPS certificate errors are ignored.

isIgnoreLinkData() - Method in class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractorConfig

Whether to ignore extra data associated with a link.

isIgnoreLinkData() - Method in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractorConfig

Gets whether to ignore extra data associated with a link.

isIgnoreLinkData() - Method in class com.norconex.crawler.web.doc.operations.link.impl.TikaLinkExtractorConfig

Whether to ignore extra data associated with a link.

isIgnoreNofollow() - Method in class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractorConfig

isIgnoreNofollow() - Method in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractorConfig

Whether to ignore "nofollow" directives on HTML links.

isIgnoreNofollow() - Method in class com.norconex.crawler.web.doc.operations.link.impl.TikaLinkExtractorConfig

isIgnoreNonTranslatedFields() - Method in class com.norconex.importer.handler.splitter.impl.TranslatorSplitterConfig

Whether to ignore fields not translated when creating child documents.

isIgnoreResponseErrors() - Method in class com.norconex.committer.azurecognitivesearch.AzureSearchCommitterConfig

Whether to ignore response errors.

isIgnoreResponseErrors() - Method in class com.norconex.committer.elasticsearch.ElasticsearchCommitterConfig

Whether to ignore response errors.

isIgnoreRobotsCrawlDelay() - Method in class com.norconex.crawler.web.doc.operations.delay.impl.BaseDelayResolverConfig

Whether to ignore crawl delays specified in a site robots.txt file.

isIgnoreValidationErrors() - Method in class com.norconex.committer.azurecognitivesearch.AzureSearchCommitterConfig

Whether to ignore validation errors.

isIncludeSubdomains() - Method in class com.norconex.crawler.web.doc.operations.scope.impl.GenericUrlScopeResolverConfig

Whether sub-domains are considered to be the same as a URL domain.

isInclusive() - Method in class com.norconex.importer.handler.transformer.impl.StripAfterTransformerConfig

Whether the match itself should be stripped or not.

isInclusive() - Method in class com.norconex.importer.handler.transformer.impl.StripBeforeTransformerConfig

Whether the match itself should be stripped or not.

isInclusive() - Method in class com.norconex.importer.handler.transformer.impl.StripBetweenOperation

isInclusive() - Method in class com.norconex.importer.handler.transformer.impl.TextBetweenOperation

isIncremental() - Method in class com.norconex.crawler.core.session.CrawlerSession

isInScope() - Method in class com.norconex.crawler.web.doc.operations.scope.UrlScope

isInterruption(Throwable) - Static method in class com.norconex.crawler.core.util.ConcurrentUtil

Whether the exception is, or has for cause, an interruption.

isKeep() - Method in class com.norconex.crawler.core.doc.operations.checksum.BaseChecksummerConfig

Whether to keep the metadata checksum value as a new metadata field.

isKeepAlive() - Method in class com.norconex.crawler.fs.fetch.impl.webdav.WebDavFetcherConfig

isKeepBadDates() - Method in class com.norconex.importer.handler.transformer.impl.DateFormatTransformerConfig

isKeepEmptySegments() - Method in class com.norconex.importer.handler.transformer.impl.HierarchyOperation

isKeepFromField() - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.MetadataMapping

Whether to keep GoogleCloudSearchCommitterConfig.MetadataMapping.fromField in structured data.

isKeepProbabilities() - Method in class com.norconex.importer.handler.transformer.impl.LanguageTransformerConfig

Whether to keep the match probabilities for each languages detected.

isKeepSourceIdField() - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig

Whether to keep the source ID field in the document metadata after it has been extracted.

isLargest() - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig

When more than one featured image is found, whether to return the largest of them all (as opposed to the first one encountered).

isLenient() - Method in class com.norconex.crawler.web.doc.operations.sitemap.impl.GenericSitemapResolverConfig

isLogContent() - Method in class com.norconex.importer.handler.transformer.impl.DebugTransformerConfig

isMatchAnyBlank() - Method in class com.norconex.importer.handler.condition.impl.BlankConditionConfig

isMatchBlanks() - Method in class com.norconex.importer.handler.transformer.impl.DomOperation

The gets whether elements with blank values should be considered a match and have an empty string returned as opposed to nothing at all.

isMaxDocsProcessedReached() - Method in class com.norconex.crawler.core.ledger.CrawlerEntryLedger

isMetadataDeduplicate() - Method in class com.norconex.crawler.core.CrawlerConfig

Whether to turn ON deduplication based on metadata checksum.

isMetadataDirectiveExecuted(FetchDirective) - Method in class com.norconex.crawler.core.doc.pipelines.importer.ImporterPipelineContext

Whether a metadata fetch request was performed already.

isNativeRetryEnabled() - Method in class com.norconex.crawler.fs.fetch.impl.m365graph.M365GraphFetcherConfig

Whether to apply M365-native retry for throttling/transient statuses.

isNegated() - Method in class com.norconex.importer.handler.condition.ConditionalDocHandler

isNewOrModified() - Method in class com.norconex.crawler.core.ledger.ProcessingOutcome

Returns whether a state indicates new or modified.

isNofollow() - Method in class com.norconex.crawler.web.doc.operations.robot.RobotsMeta

isNoindex() - Method in class com.norconex.crawler.web.doc.operations.robot.RobotsMeta

isNot(PipelineStatus) - Method in enum class com.norconex.crawler.core.cluster.pipeline.PipelineStatus

isOneOf(ProcessingOutcome...) - Method in class com.norconex.crawler.core.ledger.ProcessingOutcome

isOpen() - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyFileSystem

isOperative() - Method in class com.norconex.committer.core.service.CommitterService

isOrphan() - Method in class com.norconex.crawler.core.ledger.CrawlerEntry

isOther() - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyFileAttributes

isParsed() - Method in class com.norconex.importer.ImporterEvent

Gets whether this document was parsed.

isPassiveMode() - Method in class com.norconex.crawler.fs.fetch.impl.ftp.FtpFetcherConfig

isPending() - Method in enum class com.norconex.crawler.core.cluster.pipeline.PipelineStatus

isPersistent() - Method in interface com.norconex.crawler.core.cluster.CacheMap

Returns whether this cache persists data across restarts.

isPersistent() - Method in interface com.norconex.crawler.core.cluster.CacheQueue

Returns whether this queue persists data across restarts.

isPersistent() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastMapAdapter

isPersistent() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastQueueAdapter

isPersistent() - Method in class com.norconex.crawler.core.cluster.impl.memory.InMemoryCacheMap

isPersistent() - Method in class com.norconex.crawler.core.cluster.impl.memory.InMemoryCacheQueue

isPersistent() - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheMap

isPersistent() - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheQueue

isPersistent() - Method in class com.norconex.crawler.core.cluster.SerializedCache

Whether this cache is persisted by the crawler between runs.

isPersistent(HazelcastInstance, String) - Static method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastUtil

isPipelineTerminated(Pipeline, StepRecord, boolean) - Static method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastUtil

Whether a pipeline should be considered "terminated", either by completing all steps (success), or having a non-COMPLETED terminal status on any of the steps (aborting the pipeline), or, having a completed step when stopping was requested.

isPost() - Method in enum class com.norconex.importer.handler.parser.ParseState

isPost(ParseState) - Static method in enum class com.norconex.importer.handler.parser.ParseState

isPostImportLinksKeep() - Method in class com.norconex.crawler.web.WebCrawlerConfig

Whether to keep the Importer-populated fields from WebCrawlerConfig.getPostImportLinks().

isPre() - Method in enum class com.norconex.importer.handler.parser.ParseState

isPre(ParseState) - Static method in enum class com.norconex.importer.handler.parser.ParseState

isPreemptive() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthConfig

Whether to perform preemptive authentication (valid for "basic" authentication method).

isPreemptiveAuth() - Method in class com.norconex.crawler.fs.fetch.impl.webdav.WebDavFetcherConfig

isProcessedEmpty() - Method in class com.norconex.crawler.core.ledger.CrawlerEntryLedger

isProcessingEmpty() - Method in class com.norconex.crawler.core.ledger.CrawlerEntryLedger

isQueuedEntryEmpty() - Method in class com.norconex.crawler.core.ledger.CrawlerEntryLedger

Returns whether the current ledger has any entries still tracked in ProcessingStatus.QUEUED state.

isQueueEmpty() - Method in class com.norconex.crawler.core.ledger.CrawlerEntryLedger

isQueueStoreEnabled() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.JdbcHazelcastConfigurer

Whether queue-store persistence should be enabled for Hazelcast queues.

isReadOnly() - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyFileSystem

isRecognized() - Method in class com.norconex.crawler.fs.fetch.impl.cmis.CmisFileAttributes

isRecrawlable(WebCrawlerEntry) - Method in class com.norconex.crawler.web.doc.operations.recrawl.impl.GenericRecrawlableResolver

isRecrawlable(WebCrawlerEntry) - Method in interface com.norconex.crawler.web.doc.operations.recrawl.RecrawlableResolver

Whether a document recrawlable or not.

isRedirected(HttpRequest, HttpResponse, HttpContext) - Method in class com.norconex.crawler.web.fetch.util.ApacheRedirectCaptureStrategy

isRegex() - Method in class com.norconex.importer.handler.transformer.impl.HierarchyOperation

isRegularFile() - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyFileAttributes

isRejected() - Method in class com.norconex.importer.handler.DocHandlerContext

isRejected() - Method in class com.norconex.importer.response.ImporterResponse

isRemoteVerificationDisabled() - Method in class com.norconex.crawler.fs.fetch.impl.ftp.FtpFetcherConfig

isResumed() - Method in class com.norconex.crawler.core.cluster.pipeline.PipelineResult

isResumed() - Method in class com.norconex.crawler.core.session.CrawlerSession

isRobotsTxtSitemapDisabled() - Method in class com.norconex.crawler.web.doc.operations.sitemap.impl.GenericSitemapLocatorConfig

Whether to disable checking for the sitemap locations in a web site robots.txt file.

isRunning() - Method in enum class com.norconex.crawler.core.cluster.pipeline.PipelineStatus

isSameFile(Path, Path) - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyFileSystemProvider

isScaleStretch() - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig

Whether to stretch to match scale size.

isSeparatorRegex() - Method in class com.norconex.importer.handler.transformer.impl.SplitOperation

Whether the separator value is a regular expression.

isShowHeaders() - Method in class com.norconex.committer.core.fs.impl.CsvFileCommitterConfig

Whether to write column names on the first line.

isSingleValue() - Method in class com.norconex.importer.handler.transformer.impl.MergeOperation

isSkipped() - Method in class com.norconex.crawler.core.ledger.ProcessingOutcome

Returns whether a state indicate the document is to be skipped (ProcessingOutcome.UNMODIFIED or ProcessingOutcome.PREMATURE).

isSniDisabled() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

Sets whether Server Name Indication (SNI) is disabled.

isSolrCommitDisabled() - Method in class com.norconex.committer.solr.SolrCommitterConfig

Whether to send an explicit commit request at the end of every batch, or let the server auto-commit.

isSplitUpsertDelete() - Method in class com.norconex.committer.core.fs.BaseFsCommitterConfig

isStandalone() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastCluster

isStandaloneNode() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastClusterNode

isStartReferencesAsync() - Method in class com.norconex.crawler.core.CrawlerConfig

Whether the start references should be loaded asynchronously.

isStartRefsQueueingComplete() - Method in class com.norconex.crawler.core.session.CrawlerSession

isStartRefsQueueingComplete() - Method in class com.norconex.crawler.core.session.CrawlerStateStore

Returns whether start-reference queuing has completed.

isStatusOfAllWorkers(PipelineStatus) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.pipeline.PipelineCoordinatorState

isStayOnDomain() - Method in class com.norconex.crawler.web.doc.operations.scope.impl.GenericUrlScopeResolverConfig

Whether the crawler should always stay on the same domain name as the domain for each URL specified as a start URL.

isStayOnPort() - Method in class com.norconex.crawler.web.doc.operations.scope.impl.GenericUrlScopeResolverConfig

Whether the crawler should always stay on the same port as the port for each URL specified as a start URL.

isStayOnProtocol() - Method in class com.norconex.crawler.web.doc.operations.scope.impl.GenericUrlScopeResolverConfig

Whether the crawler should always stay on the same protocol as the protocol for each URL specified as a start URL.

isStayOnSitemap() - Method in class com.norconex.crawler.web.doc.operations.scope.impl.GenericUrlScopeResolverConfig

Whether to limit crawling to entries found in an existing website sitemap (do not go deeper).

isStopped() - Method in enum class com.norconex.crawler.core.cluster.pipeline.PipelineStatus

isStopping() - Method in enum class com.norconex.crawler.core.cluster.pipeline.PipelineStatus

isStopRequested() - Method in class com.norconex.crawler.core.cluster.pipeline.BaseStep

isStopRequested() - Method in interface com.norconex.crawler.core.cluster.pipeline.Step

Indicates whether this step has been asked to stop.

isStretch() - Method in class com.norconex.importer.handler.transformer.impl.ImageTransformerConfig.Scale

isSuccess() - Method in class com.norconex.importer.response.ImporterResponse

isSupportedCacheType(Object) - Static method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastUtil

isSymbolicLink() - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyFileAttributes

isTerminal() - Method in enum class com.norconex.crawler.core.cluster.pipeline.PipelineStatus

isTerminal() - Method in enum class com.norconex.crawler.core.session.CrawlerState

isTimedOut() - Method in class com.norconex.crawler.core.cluster.pipeline.PipelineResult

isTimestamped() - Method in class com.norconex.crawler.web.event.listeners.UrlStatusCrawlerEventListenerConfig

Whether to add a timestamp to the file name, to ensure a new one is created with each run.

isTrustAllSSLCertificates() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

Sets whether to trust all SSL certificate (affects only "https" connections).

isUseFirstRowAsFields() - Method in class com.norconex.importer.handler.splitter.impl.CsvSplitterConfig

Whether to use the first row as field names for values.

isUseHtmlUnit() - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig

Experimental feature where the selected WebDriverBrowser will be used to configure and use HtmlUnit WebDriver as a wrapper instead of directly using the browser WebDriver.

isUserDirIsRoot() - Method in class com.norconex.crawler.fs.fetch.impl.ftp.FtpFetcherConfig

isUserDirIsRoot() - Method in class com.norconex.crawler.fs.fetch.impl.sftp.SftpFetcherConfig

isUseTicketCache() - Method in class com.norconex.crawler.fs.fetch.impl.hdfs.KerberosConfig

Whether to use the system ticket cache for authentication.

isUseTicketCache() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.KerberosConfig

Whether to use the system ticket cache for authentication.

isUseWindowsAuth() - Method in class com.norconex.committer.azurecognitivesearch.AzureSearchCommitterConfig

Whether to use integrated Windows Authentication (if applicable).

isWithHeaders() - Method in class com.norconex.importer.handler.transformer.impl.FieldReportTransformerConfig

isWithOccurences() - Method in class com.norconex.importer.handler.transformer.impl.FieldReportTransformerConfig

isWriteCoalescing() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.JdbcHazelcastConfigurer

Whether to coalesce write-behind updates so that only the latest value for each key is persisted per batch.

ITEM - Enum constant in enum class com.norconex.crawler.fs.fetch.impl.FolderItemReferenceParser.Kind

itemId() - Method in record class com.norconex.crawler.fs.fetch.impl.FolderItemReferenceParser.Parsed

Returns the value of the itemId record component.

iterator() - Method in interface com.norconex.crawler.core.cluster.CacheSet

iterator() - Method in class com.norconex.crawler.core.cluster.impl.memory.InMemoryCacheSet

iterator() - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheSet

iterator() - Method in class com.norconex.crawler.core.cluster.SerializedCache

Lazy-loaded (in batches) cache entries iterator.

iterator() - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyPath

J

JacksonCompactSerializer<T> - Class in com.norconex.crawler.core.cluster.impl.hazelcast

A generic Hazelcast Compact serializer that delegates to Jackson (via SerialUtil) for the actual serialization.

JacksonCompactSerializer(Class<T>) - Constructor for class com.norconex.crawler.core.cluster.impl.hazelcast.JacksonCompactSerializer

JAVASCRIPT_ENGINE - Static variable in class com.norconex.importer.handler.ScriptRunner

JdbcClient - Class in com.norconex.crawler.core.cluster.impl.hazelcast.jdbc

JdbcClient(HazelcastInstance, Properties) - Constructor for class com.norconex.crawler.core.cluster.impl.hazelcast.jdbc.JdbcClient

JdbcClient.SQLTask - Interface in com.norconex.crawler.core.cluster.impl.hazelcast.jdbc

JdbcHazelcastConfigurer - Class in com.norconex.crawler.core.cluster.impl.hazelcast

Default HazelcastConfigurer implementation that builds the Hazelcast configuration programmatically using a JDBC data source for persistence.

JdbcHazelcastConfigurer() - Constructor for class com.norconex.crawler.core.cluster.impl.hazelcast.JdbcHazelcastConfigurer

JMX Support - Search tag in class com.norconex.crawler.core.context.CrawlerContext

Section

jsonFactory() - Static method in class com.norconex.crawler.core.util.SerialUtil

JsonFileCommitter - Class in com.norconex.committer.core.fs.impl

Commits documents to JSON files.

JsonFileCommitter() - Constructor for class com.norconex.committer.core.fs.impl.JsonFileCommitter

JsonFileCommitterConfig - Class in com.norconex.committer.core.fs.impl

Configuration for the JsonFileCommitter.

JsonFileCommitterConfig() - Constructor for class com.norconex.committer.core.fs.impl.JsonFileCommitterConfig

JsonFileCommitterConfig.Fields - Class in com.norconex.committer.core.fs.impl

jsonGenerator(OutputStream) - Static method in class com.norconex.crawler.core.util.SerialUtil

jsonGenerator(OutputStream, boolean) - Static method in class com.norconex.crawler.core.util.SerialUtil

JSON Objects - Search tag in class com.norconex.committer.elasticsearch.ElasticsearchCommitter

Section

jsonParser(InputStream) - Static method in class com.norconex.crawler.core.util.SerialUtil

K

keepBadDates - Static variable in class com.norconex.importer.handler.transformer.impl.DateFormatTransformerConfig.Fields

Keeping Referenced Links - Search tag in class com.norconex.crawler.web.WebCrawlerConfig

Section

KeepOnlyTransformer - Class in com.norconex.importer.handler.transformer.impl

Keep only the metadata fields provided, delete all other ones.

KeepOnlyTransformer() - Constructor for class com.norconex.importer.handler.transformer.impl.KeepOnlyTransformer

KeepOnlyTransformerConfig - Class in com.norconex.importer.handler.transformer.impl

Keep only the metadata fields provided, delete all other ones.

KeepOnlyTransformerConfig() - Constructor for class com.norconex.importer.handler.transformer.impl.KeepOnlyTransformerConfig

keepReferencedLinks - Static variable in class com.norconex.crawler.web.WebCrawlerConfig.Fields

KERBEROS - Enum constant in enum class com.norconex.crawler.fs.fetch.impl.hdfs.HdfsAuthMethod

Kerberos/SPNEGO authentication, for clusters with hadoop.security.authentication=kerberos.

KERBEROS - Enum constant in enum class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthMethod

Kerberos authentication method.

kerberosConfig - Static variable in class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthConfig.Fields

KerberosConfig - Class in com.norconex.crawler.fs.fetch.impl.hdfs

Configuration for Kerberos/SPNEGO authentication against a secured WebHDFS endpoint.

KerberosConfig - Class in com.norconex.crawler.web.fetch.impl.httpclient

Configuration for Kerberos and SPNEGO authentication.

KerberosConfig() - Constructor for class com.norconex.crawler.fs.fetch.impl.hdfs.KerberosConfig

KerberosConfig() - Constructor for class com.norconex.crawler.web.fetch.impl.httpclient.KerberosConfig

Key advantages over WebDriverFetcher - Search tag in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcher

Section

keys() - Method in interface com.norconex.crawler.core.cluster.CacheMap

Returns all keys in this cache.

keys() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastMapAdapter

keys() - Method in class com.norconex.crawler.core.cluster.impl.memory.InMemoryCacheMap

keys() - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheMap

KEYWORDS - Enum constant in enum class com.norconex.committer.googlecloudsearch.MetadataField

kind() - Method in record class com.norconex.crawler.fs.fetch.impl.FolderItemReferenceParser.Parsed

Returns the value of the kind record component.

L

Labelable - Interface in com.norconex.importer.handler

An importer flow node or configuration bean that exposes an optional user-supplied label.

language - Static variable in class com.norconex.importer.handler.parser.impl.OcrConfig.Fields

LANGUAGE - Static variable in class com.norconex.importer.doc.DocMetaConstants

Document language.

LanguageTransformer - Class in com.norconex.importer.handler.transformer.impl

Detects a document language based on Apache Tika language detection capability.

LanguageTransformer() - Constructor for class com.norconex.importer.handler.transformer.impl.LanguageTransformer

LanguageTransformerConfig - Class in com.norconex.importer.handler.transformer.impl

Detects a document language based on Apache Tika language detection capability.

LanguageTransformerConfig() - Constructor for class com.norconex.importer.handler.transformer.impl.LanguageTransformerConfig

LAST - Enum constant in enum class com.norconex.crawler.web.doc.operations.recrawl.impl.GenericRecrawlableResolverConfig.SitemapSupport

LAST_MODIFIED - Static variable in class com.norconex.crawler.fs.doc.FsDocMetadata

LAST_MODIFIED_FIELD - Static variable in class com.norconex.crawler.web.doc.operations.checksum.impl.LastModifiedMetadataChecksummer

HTTP header name used to perform checksum.

lastAccessTime() - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyFileAttributes

lastModified - Static variable in class com.norconex.crawler.core.ledger.CrawlerEntry.Fields

LastModifiedMetadataChecksummer - Class in com.norconex.crawler.web.doc.operations.checksum.impl

Default implementation of MetadataChecksummer for the Norconex Web Crawler which simply returns the exact value of the "Last-Modified" HTTP header field, or null if not present.

LastModifiedMetadataChecksummer() - Constructor for class com.norconex.crawler.web.doc.operations.checksum.impl.LastModifiedMetadataChecksummer

lastModifiedTime() - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyFileAttributes

lastStepId(String) - Method in class com.norconex.crawler.core.cluster.pipeline.PipelineResult.PipelineResultBuilder

launch(CrawlerDriver, String...) - Static method in class com.norconex.crawler.core.cli.CliCrawlerLauncher

launch(String...) - Static method in class com.norconex.crawler.fs.FsCrawler

launch(String...) - Static method in class com.norconex.crawler.web.WebCrawler

Launches the Web Crawler.

launch(String[]) - Static method in class com.norconex.importer.ImporterLauncher

LazyTypedStoreFactory - Interface in com.norconex.crawler.core.cluster.impl.hazelcast

LB_HTTP - Enum constant in enum class com.norconex.committer.solr.SolrClientType

Deprecated.

use SolrClientType.LB_HTTP2 instead.

LB_HTTP2 - Enum constant in enum class com.norconex.committer.solr.SolrClientType

A client using the HTTP/2 protocol (via Jetty), performing simple load-balancing as an alternative to an external load balancer.

Link - Class in com.norconex.crawler.web.doc.operations.link

Represents a link extracted from a document.

Link(String) - Constructor for class com.norconex.crawler.web.doc.operations.link.Link

LinkExtractor - Interface in com.norconex.crawler.web.doc.operations.link

Responsible for finding links in documents.

linkExtractors - Static variable in class com.norconex.crawler.web.WebCrawlerConfig.Fields

LinkExtractorStage - Class in com.norconex.crawler.web.doc.pipelines.importer.stages

Extract URLs before sending to importer (because the importer may strip some "valid" urls in producing normalized content).

LinkExtractorStage() - Constructor for class com.norconex.crawler.web.doc.pipelines.importer.stages.LinkExtractorStage

LinkSelector() - Constructor for class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractorConfig.LinkSelector

LinkSelector(String, String) - Constructor for class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractorConfig.LinkSelector

LINKTEXT - Enum constant in enum class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcherConfig.WaitElementType

Locate by visible link text.

LINKTEXT - Enum constant in enum class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig.WaitElementType

load(Long) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.jdbc.StringJdbcQueueStore

load(Long) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.jdbc.TypedJdbcQueueStore

load(String) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.jdbc.StringJdbcMapStore

load(String, Map<String, Object>) - Static method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastConfigLoader

loadAll() - Method in interface com.norconex.crawler.core.cluster.CacheMap

Eagerly loads all entries from the backing store (e.g., JDBC) into this cache.

loadAll() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastMapAdapter

loadAll(Collection<Long>) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.jdbc.StringJdbcQueueStore

loadAll(Collection<Long>) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.jdbc.TypedJdbcQueueStore

loadAll(Collection<String>) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.jdbc.StringJdbcMapStore

loadAllKeys() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.jdbc.StringJdbcMapStore

loadAllKeys() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.jdbc.StringJdbcQueueStore

loadAllKeys() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.jdbc.TypedJdbcQueueStore

loadState() - Method in class com.norconex.crawler.core.session.CrawlerSession

loadState() - Method in class com.norconex.crawler.core.session.CrawlerStateStore

Loads the current crawl state directly from the distributed cache.

LocalFetcher - Class in com.norconex.crawler.fs.fetch.impl.local

Fetcher for a local file system, backed by the JDK's default FileSystemProvider.

LocalFetcher() - Constructor for class com.norconex.crawler.fs.fetch.impl.local.LocalFetcher

LocalFetcherConfig - Class in com.norconex.crawler.fs.fetch.impl.local

Configuration for LocalFetcher.

LocalFetcherConfig() - Constructor for class com.norconex.crawler.fs.fetch.impl.local.LocalFetcherConfig

LocalPipelineManager - Class in com.norconex.crawler.core.cluster.impl.memory

Single-node pipeline manager that executes steps sequentially on the calling thread.

LocalPipelineManager(CrawlerSession) - Constructor for class com.norconex.crawler.core.cluster.impl.memory.LocalPipelineManager

localQueueSize() - Method in class com.norconex.crawler.core.cmd.crawl.pipeline.process.BatchDispatcher

location(String) - Method in class com.norconex.crawler.web.doc.operations.sitemap.SitemapContext.SitemapContextBuilder

locations(String, CrawlerSession) - Method in class com.norconex.crawler.web.doc.operations.sitemap.impl.GenericSitemapLocator

locations(String, CrawlerSession) - Method in interface com.norconex.crawler.web.doc.operations.sitemap.SitemapLocator

LockMapExecutor - Class in com.norconex.crawler.core.cluster.impl.hazelcast

LockMapExecutor(HazelcastInstance, String, Duration) - Constructor for class com.norconex.crawler.core.cluster.impl.hazelcast.LockMapExecutor

logCommandIntro(Logger, CrawlerConfig) - Static method in class com.norconex.crawler.core.util.LogUtil

LogCommitter - Class in com.norconex.committer.core.impl

WARNING: Not intended for production use.

LogCommitter() - Constructor for class com.norconex.committer.core.impl.LogCommitter

LogCommitterConfig - Class in com.norconex.committer.core.impl

LogCommitterConfig() - Constructor for class com.norconex.committer.core.impl.LogCommitterConfig

LogCommitterConfig.LogLevel - Enum Class in com.norconex.committer.core.impl

LogUtil - Class in com.norconex.crawler.core.util

LOW - Enum constant in enum class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig.Quality

LOWERCASE - Enum constant in enum class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizerConfig.Normalization

LOWERCASE_PATH - Enum constant in enum class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizerConfig.Normalization

LOWERCASE_QUERY - Enum constant in enum class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizerConfig.Normalization

LOWERCASE_QUERY_PARAMETER_NAMES - Enum constant in enum class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizerConfig.Normalization

LOWERCASE_QUERY_PARAMETER_VALUES - Enum constant in enum class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizerConfig.Normalization

LOWERCASE_SCHEME_HOST - Enum constant in enum class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizerConfig.Normalization

lowWatermark(int) - Method in class com.norconex.crawler.core.cmd.crawl.pipeline.process.BatchDispatcher.BatchDispatcherBuilder

Threshold below which a new reference batch is poll from the queue, so the local node queue never gets dry.

LUA_ENGINE - Static variable in class com.norconex.importer.handler.ScriptRunner

M

M365GraphFetcher - Class in com.norconex.crawler.fs.fetch.impl.m365graph

Microsoft 365 Graph fetcher for SharePoint Online and OneDrive.

M365GraphFetcher() - Constructor for class com.norconex.crawler.fs.fetch.impl.m365graph.M365GraphFetcher

M365GraphFetcherConfig - Class in com.norconex.crawler.fs.fetch.impl.m365graph

Configuration for M365GraphFetcher.

M365GraphFetcherConfig() - Constructor for class com.norconex.crawler.fs.fetch.impl.m365graph.M365GraphFetcherConfig

M365GraphFetcherConfig.SourceDeltaExpansion - Enum Class in com.norconex.crawler.fs.fetch.impl.m365graph

main(String[]) - Static method in class com.norconex.crawler.fs.FsCrawler

Invokes the File System Crawler from the command line.

main(String[]) - Static method in class com.norconex.crawler.web.WebCrawler

Invokes the Web Crawler from the command line.

main(String[]) - Static method in class com.norconex.importer.Importer

Invokes the importer from the command line.

MAP - Enum constant in enum class com.norconex.crawler.core.cluster.SerializedCache.CacheType

MAP_STORE_FACTORY_CLASS - Static variable in class com.norconex.crawler.core.cluster.impl.hazelcast.JdbcHazelcastConfigurer

Factory class for JDBC-backed map stores.

markClosed() - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyFileSystem

matches(String) - Method in class com.norconex.crawler.web.doc.operations.delay.impl.DelayReferencePattern

matchesContentType(TextMatcher, ContentType) - Static method in class com.norconex.importer.util.MatchUtil

Null-safe matches a content type.

matchesContentType(TextMatcher, Doc) - Static method in class com.norconex.importer.util.MatchUtil

Null-safe matches a document record content type.

Matching links - Search tag in class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractor

Section

MatchUtil - Class in com.norconex.importer.util

MAX - Enum constant in enum class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig.Quality

MAX_CONTENT_FROM_END_TO_CUT - Static variable in class com.norconex.importer.util.BufferUtil

maxBatchSize(int) - Method in class com.norconex.crawler.core.cmd.crawl.pipeline.process.BatchDispatcher.BatchDispatcherBuilder

Maximum number of references for a node to poll at once from the queue for processing.

maxChunkSize() - Method in class com.norconex.importer.util.ReadAdapter.ChunkedReadOptions

maxChunkSize(int) - Method in class com.norconex.importer.util.chunk.ChunkedTextReader.ChunkedTextReaderBuilder

maxChunkSize(int) - Method in class com.norconex.importer.util.ReadAdapter.ChunkedReadOptions

maxCrawlDuration - Static variable in class com.norconex.crawler.core.CrawlerConfig.Fields

maxDepth - Static variable in class com.norconex.crawler.core.CrawlerConfig.Fields

MAXDEPTH - Enum constant in enum class com.norconex.crawler.web.WebCrawlerConfig.ReferencedLinkType

maxDocuments - Static variable in class com.norconex.crawler.core.CrawlerConfig.Fields

maxFileSizeToOcr - Static variable in class com.norconex.importer.handler.parser.impl.OcrConfig.Fields

maxQueueBatchSize - Static variable in class com.norconex.crawler.core.CrawlerConfig.Fields

Max read size - Search tag in class com.norconex.importer.handler.transformer.impl.TitleGeneratorTransformer

Section

Max read size - Search tag in class com.norconex.importer.handler.transformer.impl.TitleGeneratorTransformerConfig

Section

maxRetries(int) - Method in class com.norconex.crawler.core.fetch.MultiFetcher.Builder

maxStreamCachePoolSize - Static variable in class com.norconex.crawler.core.CrawlerConfig.Fields

maxStreamCacheSize - Static variable in class com.norconex.crawler.core.CrawlerConfig.Fields

Md5DocumentChecksummer - Class in com.norconex.crawler.core.doc.operations.checksum.impl

Implementation of DocumentChecksummer which returns a MD5 checksum value of the extracted document content unless one or more given source fields are specified, in which case the MD5 checksum value is constructed from those fields.

Md5DocumentChecksummer() - Constructor for class com.norconex.crawler.core.doc.operations.checksum.impl.Md5DocumentChecksummer

Md5DocumentChecksummerConfig - Class in com.norconex.crawler.core.doc.operations.checksum.impl

Configuration for Md5DocumentChecksummer.

Md5DocumentChecksummerConfig() - Constructor for class com.norconex.crawler.core.doc.operations.checksum.impl.Md5DocumentChecksummerConfig

MDC_CRAWLER_ID - Static variable in class com.norconex.crawler.core.util.LogUtil

MDC_CRAWLER_ID_SAFE - Static variable in class com.norconex.crawler.core.util.LogUtil

MEDIUM - Enum constant in enum class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig.Quality

MemoryCacheManager - Class in com.norconex.crawler.core.cluster.impl.memory

In-memory CacheManager for the memory (non-clustered) mode.

MemoryCacheManager() - Constructor for class com.norconex.crawler.core.cluster.impl.memory.MemoryCacheManager

MemoryCluster - Class in com.norconex.crawler.core.cluster.impl.memory

Lightweight single-node Cluster implementation that requires no Hazelcast or any external infrastructure.

MemoryCluster() - Constructor for class com.norconex.crawler.core.cluster.impl.memory.MemoryCluster

MemoryClusterConnector - Class in com.norconex.crawler.core.cluster.impl.memory

Connector that creates a lightweight MemoryCluster with in-memory caches and no distributed infrastructure.

MemoryClusterConnector() - Constructor for class com.norconex.crawler.core.cluster.impl.memory.MemoryClusterConnector

MemoryCommitter - Class in com.norconex.committer.core.impl

WARNING: Not intended for production use.

MemoryCommitter() - Constructor for class com.norconex.committer.core.impl.MemoryCommitter

MemoryCommitterConfig - Class in com.norconex.committer.core.impl

MemoryCommitterConfig() - Constructor for class com.norconex.committer.core.impl.MemoryCommitterConfig

merge(String, T, BiFunction<? super T, ? super T, ? extends T>) - Method in interface com.norconex.crawler.core.cluster.CacheMap

merge(String, T, BiFunction<? super T, ? super T, ? extends T>) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastMapAdapter

merge(String, T, BiFunction<? super T, ? super T, ? extends T>) - Method in class com.norconex.crawler.core.cluster.impl.memory.InMemoryCacheMap

merge(String, T, BiFunction<? super T, ? super T, ? extends T>) - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheMap

MergeOperation - Class in com.norconex.importer.handler.transformer.impl

MergeOperation() - Constructor for class com.norconex.importer.handler.transformer.impl.MergeOperation

MergeTransformer - Class in com.norconex.importer.handler.transformer.impl

Merge multiple metadata fields into a single one.

MergeTransformer() - Constructor for class com.norconex.importer.handler.transformer.impl.MergeTransformer

MergeTransformerConfig - Class in com.norconex.importer.handler.transformer.impl

Merge multiple metadata fields into a single one.

MergeTransformerConfig() - Constructor for class com.norconex.importer.handler.transformer.impl.MergeTransformerConfig

META_FORMAT_JSON - Static variable in class com.norconex.importer.handler.transformer.impl.ExternalTransformerConfig

META_FORMAT_PROPERTIES - Static variable in class com.norconex.importer.handler.transformer.impl.ExternalTransformerConfig

META_FORMAT_XML - Static variable in class com.norconex.importer.handler.transformer.impl.ExternalTransformerConfig

metaChecksum - Static variable in class com.norconex.crawler.core.ledger.CrawlerEntry.Fields

metadata() - Method in class com.norconex.importer.handler.DocHandlerContext

METADATA - Enum constant in enum class com.norconex.crawler.core.fetch.FetchDirective

A directive to execute a fetch request separate from document fetch.

METADATA - Enum constant in enum class com.norconex.crawler.web.fetch.util.DocImageHandlerConfig.Target

Store image in metadata field.

metadataChecksumMD5(Properties, TextMatcher) - Static method in class com.norconex.crawler.core.doc.operations.checksum.ChecksumUtil

metadataChecksummer - Static variable in class com.norconex.crawler.core.CrawlerConfig.Fields

MetadataChecksummer - Interface in com.norconex.crawler.core.doc.operations.checksum

Creates a checksum representing a document based on document metadata values obtained prior to fetching that document (e.g.

metadataChecksumPlain(Properties, TextMatcher) - Static method in class com.norconex.crawler.core.doc.operations.checksum.ChecksumUtil

MetadataChecksumStage - Class in com.norconex.crawler.core.doc.pipelines.importer.stages

Creates a checksum based on fetched metadata.

MetadataChecksumStage(FetchDirective) - Constructor for class com.norconex.crawler.core.doc.pipelines.importer.stages.MetadataChecksumStage

Metadata date field format: - Search tag in class com.norconex.importer.handler.condition.impl.DateCondition

Section

Metadata date field format: - Search tag in class com.norconex.importer.handler.condition.impl.DateConditionConfig

Section

metadataDeduplicate - Static variable in class com.norconex.crawler.core.CrawlerConfig.Fields

MetadataDedupStage - Class in com.norconex.crawler.core.doc.pipelines.importer.stages

Provided both document checksum and deduplication are enabled, verify there are no other documents with the same metadata checksum.

MetadataDedupStage(FetchDirective) - Constructor for class com.norconex.crawler.core.doc.pipelines.importer.stages.MetadataDedupStage

metadataFetchSupport - Static variable in class com.norconex.crawler.core.CrawlerConfig.Fields

MetadataField - Enum Class in com.norconex.committer.googlecloudsearch

Supported Google Cloud Search item metadata targets.

MetadataFilter - Interface in com.norconex.crawler.core.doc.operations.filter

Filter a reference based on the metadata that could be obtained for a document, before it was fetched, downloaded, or otherwise read or acquired (e.g.

metadataFilters - Static variable in class com.norconex.crawler.core.CrawlerConfig.Fields

MetadataFiltersStage - Class in com.norconex.crawler.core.doc.pipelines.importer.stages

Filters documents based on fetched metadata.

MetadataFiltersStage(FetchDirective) - Constructor for class com.norconex.crawler.core.doc.pipelines.importer.stages.MetadataFiltersStage

MetadataMapping() - Constructor for class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.MetadataMapping

method - Static variable in class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthConfig.Fields

metrics(CrawlerMetrics) - Method in class com.norconex.crawler.core.context.CrawlerContext.Builder

MIME_TYPE - Enum constant in enum class com.norconex.committer.googlecloudsearch.MetadataField

minFileSizeToOcr - Static variable in class com.norconex.importer.handler.parser.impl.OcrConfig.Fields

MinFrequency() - Constructor for class com.norconex.crawler.web.doc.operations.recrawl.impl.GenericRecrawlableResolverConfig.MinFrequency

MinFrequency(GenericRecrawlableResolverConfig.MinFrequency.ApplyTo, String, TextMatcher) - Constructor for class com.norconex.crawler.web.doc.operations.recrawl.impl.GenericRecrawlableResolverConfig.MinFrequency

minProgressLoggingInterval - Static variable in class com.norconex.crawler.core.CrawlerConfig.Fields

MINUTE - Enum constant in enum class com.norconex.importer.handler.condition.impl.DateCondition.TimeUnit

MODIFIED - Static variable in class com.norconex.crawler.core.ledger.ProcessingOutcome

MON - Enum constant in enum class com.norconex.crawler.web.doc.operations.delay.impl.DelaySchedule.DOW

MONGO_CSV1_7 - Enum constant in enum class com.norconex.committer.core.fs.impl.CsvFileCommitterConfig.CsvFormat

MONGO_TSV1_7 - Enum constant in enum class com.norconex.committer.core.fs.impl.CsvFileCommitterConfig.CsvFormat

MONTH - Enum constant in enum class com.norconex.importer.handler.condition.impl.DateCondition.TimeUnit

MONTHLY - Enum constant in enum class com.norconex.crawler.web.doc.operations.sitemap.SitemapChangeFrequency

move(Path, Path, CopyOption...) - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyFileSystemProvider

MultiFetcher - Class in com.norconex.crawler.core.fetch

Implementation of Fetcher that groups multiple other fetcher to treat them as a single fetcher.

MultiFetcher.Builder - Class in com.norconex.crawler.core.fetch

MultiFetcher.ResponseAggregator - Interface in com.norconex.crawler.core.fetch

MultiFetcher.UnsuccessfulResponseFactory - Interface in com.norconex.crawler.core.fetch

Multiple fields and values: - Search tag in class com.norconex.importer.handler.condition.impl.BlankCondition

Section

Multiple fields and values: - Search tag in class com.norconex.importer.handler.condition.impl.BlankConditionConfig

Section

multiValueJoinDelimiter - Static variable in class com.norconex.committer.core.fs.impl.CsvFileCommitterConfig.Fields

MVStoreCacheManager - Class in com.norconex.crawler.core.cluster.impl.mvstore

CacheManager backed by H2 MVStore for persistent caches and in-memory structures for ephemeral caches (eph-*).

MVStoreCacheManager() - Constructor for class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheManager

MVStoreCacheMap<T> - Class in com.norconex.crawler.core.cluster.impl.mvstore

File-backed CacheMap implementation using H2 MVStore.

MVStoreCacheMap(MVMap<String, String>, Class<T>, String, boolean) - Constructor for class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheMap

MVStoreCacheQueue<T> - Class in com.norconex.crawler.core.cluster.impl.mvstore

File-backed FIFO CacheQueue implementation using H2 MVStore.

MVStoreCacheQueue(MVMap<Long, String>, Class<T>, String) - Constructor for class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheQueue

MVStoreCacheSet - Class in com.norconex.crawler.core.cluster.impl.mvstore

File-backed CacheSet implementation using H2 MVStore.

MVStoreCacheSet(MVMap<String, Boolean>) - Constructor for class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheSet

MVStoreCluster - Class in com.norconex.crawler.core.cluster.impl.mvstore

File-backed single-node Cluster implementation using H2 MVStore.

MVStoreClusterConnector - Class in com.norconex.crawler.core.cluster.impl.mvstore

Connector that creates a file-backed MVStoreCluster using H2's MVStore engine.

MVStoreClusterConnector() - Constructor for class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreClusterConnector

MVStoreClusterConnectorConfig - Class in com.norconex.crawler.core.cluster.impl.mvstore

Configuration for the MVStore-based cluster connector.

MVStoreClusterConnectorConfig() - Constructor for class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreClusterConnectorConfig

MYSQL - Enum constant in enum class com.norconex.committer.core.fs.impl.CsvFileCommitterConfig.CsvFormat

N

"nofollow" - Search tag in class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractor

Section

"nofollow" - Search tag in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractor

Section

NAME - Enum constant in enum class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcherConfig.WaitElementType

Locate by name attribute.

NAME - Enum constant in enum class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig.WaitElementType

NAME - Static variable in class com.norconex.crawler.core.context.CrawlerContext

NAME - Static variable in class com.norconex.importer.handler.condition.AllOf

Serialization ID name.

NAME - Static variable in class com.norconex.importer.handler.condition.AnyOf

Serialization ID name.

NAME - Static variable in class com.norconex.importer.handler.condition.If

Serialization ID name.

NAME - Static variable in class com.norconex.importer.handler.condition.IfNot

Serialization ID name.

NAME - Static variable in class com.norconex.importer.handler.condition.NoneOf

Serialization ID name.

NAME - Static variable in interface com.norconex.importer.handler.DocHandler

Default serialization id name.

Neo4jCommitter - Class in com.norconex.committer.neo4j

Commit documents/fields to a Neo4j graph database.

Neo4jCommitter() - Constructor for class com.norconex.committer.neo4j.Neo4jCommitter

Neo4jCommitterConfig - Class in com.norconex.committer.neo4j

Neo4j Committer configuration.

Neo4jCommitterConfig() - Constructor for class com.norconex.committer.neo4j.Neo4jCommitterConfig

Neo4jCommitterPtProvider - Class in com.norconex.committer.neo4j.spi

For auto registering in BeanMapper.

Neo4jCommitterPtProvider() - Constructor for class com.norconex.committer.neo4j.spi.Neo4jCommitterPtProvider

NEVER - Enum constant in enum class com.norconex.crawler.web.doc.operations.recrawl.impl.GenericRecrawlableResolverConfig.SitemapSupport

NEVER - Enum constant in enum class com.norconex.crawler.web.doc.operations.sitemap.SitemapChangeFrequency

NEW - Enum constant in enum class com.norconex.crawler.core.session.CrawlerResumeState

The crawler started from the beginning (first-time or restarted after success, regardless of crawl mode -- incremental or full).

NEW - Static variable in class com.norconex.crawler.core.ledger.ProcessingOutcome

newByteChannel(Path, Set<? extends OpenOption>, FileAttribute<?>...) - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyFileSystemProvider

newMapStore(String, Properties) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.jdbc.TypedJdbcMapStoreFactory

newQueueStore(String, Properties) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.jdbc.TypedJdbcQueueStoreFactory

newWatchService() - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyFileSystem

nextQueuedBatch(int) - Method in class com.norconex.crawler.core.ledger.CrawlerEntryLedger

nodeUrl(String) - Method in class com.norconex.crawler.core.cluster.admin.ClusterAdminClient.ClusterAdminClientBuilder

nodeUrls(Collection<? extends String>) - Method in class com.norconex.crawler.core.cluster.admin.ClusterAdminClient.ClusterAdminClientBuilder

NONE - Enum constant in enum class com.norconex.crawler.web.doc.operations.scope.UrlScopeResolver.SitemapPresence

NoneOf - Class in com.norconex.importer.handler.condition

NoneOf(List<Condition>) - Constructor for class com.norconex.importer.handler.condition.NoneOf

NORCONEX_ASCII - Static variable in class com.norconex.crawler.core.util.About

Simple ASCI art of Norconex.

NormalizationReplace(String) - Constructor for class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizerConfig.NormalizationReplace

NormalizationReplace(String, String) - Constructor for class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizerConfig.NormalizationReplace

normalize() - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyPath

normalizedPath() - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyPath

normalizeURL(String) - Method in class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizer

normalizeURL(String) - Method in interface com.norconex.crawler.web.doc.operations.url.WebUrlNormalizer

Normalize the given URL.

normalizeURL(String, List<WebUrlNormalizer>) - Static method in interface com.norconex.crawler.web.doc.operations.url.WebUrlNormalizer

Normalizes a URL by applying each normalizers in the list.

NOT_APPLICABLE - Enum constant in enum class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.AclInheritanceType

NOT_FOUND - Static variable in class com.norconex.crawler.core.ledger.ProcessingOutcome

NTLM - Enum constant in enum class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthMethod

Deprecated.

numeric() - Method in class com.norconex.crawler.core.util.StringSanitizer.Builder

NumericCondition - Class in com.norconex.importer.handler.condition.impl

A condition based on the numeric value(s) of matching metadata fields, supporting decimals.

NumericCondition() - Constructor for class com.norconex.importer.handler.condition.impl.NumericCondition

NumericCondition.Fields - Class in com.norconex.importer.handler.condition.impl

NumericConditionConfig - Class in com.norconex.importer.handler.condition.impl

A condition based on the numeric value(s) of matching metadata fields, supporting decimals.

NumericConditionConfig() - Constructor for class com.norconex.importer.handler.condition.impl.NumericConditionConfig

NumericValueMatcher - Class in com.norconex.importer.handler.condition.impl

NumericValueMatcher(Operator, double) - Constructor for class com.norconex.importer.handler.condition.impl.NumericValueMatcher

numThreads - Static variable in class com.norconex.crawler.core.CrawlerConfig.Fields

O

OBJECT_TYPE - Enum constant in enum class com.norconex.committer.googlecloudsearch.MetadataField

OcrConfig - Class in com.norconex.importer.handler.parser.impl

OCR configuration details.

OcrConfig() - Constructor for class com.norconex.importer.handler.parser.impl.OcrConfig

OcrConfig.Fields - Class in com.norconex.importer.handler.parser.impl

of(TextMatcher, String) - Static method in class com.norconex.importer.handler.transformer.impl.CopyOperation

of(TextMatcher, String, PropertySetter) - Static method in class com.norconex.importer.handler.transformer.impl.CopyOperation

of(String) - Static method in class com.norconex.importer.handler.transformer.impl.CopyOperation

of(String, String) - Static method in class com.norconex.importer.handler.transformer.impl.Constant

of(String, List<String>) - Static method in class com.norconex.importer.handler.transformer.impl.Constant

of(String, List<String>, PropertySetter) - Static method in class com.norconex.importer.handler.transformer.impl.Constant

of(String) - Static method in enum class com.norconex.committer.solr.SolrClientType

of(String) - Static method in enum class com.norconex.crawler.core.ledger.ProcessingStatus

of(String) - Static method in enum class com.norconex.crawler.web.doc.operations.sitemap.SitemapChangeFrequency

Gets the sitemap change frequency matching the supplied string.

of(String) - Static method in enum class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverBrowser

of(String, Serializable) - Static method in class com.norconex.crawler.core.cluster.QueryFilter

Creation method.

ofAll() - Static method in class com.norconex.crawler.core.cluster.QueryFilter

Creation method to return all entries.

OFF - Enum constant in enum class com.norconex.committer.core.batch.queue.impl.FsQueue.SplitBatch

onAccepted(Consumer<T>) - Method in class com.norconex.crawler.core.doc.operations.filter.FilterGroupResolver.FilterGroupResolverBuilder

oncePerRun(String, Runnable) - Method in class com.norconex.crawler.core.session.CrawlerRunCoordinator

Runs runnable exactly once per crawl run (across all nodes).

oncePerRun(String, Runnable) - Method in class com.norconex.crawler.core.session.CrawlerSession

oncePerRunAndGet(String, Supplier<T>) - Method in class com.norconex.crawler.core.session.CrawlerRunCoordinator

Computes a value exactly once per crawl run (across all nodes) and returns the cached result on subsequent calls.

oncePerRunAndGet(String, Supplier<T>) - Method in class com.norconex.crawler.core.session.CrawlerSession

oncePerSession(String, Runnable) - Method in class com.norconex.crawler.core.session.CrawlerRunCoordinator

Runs runnable exactly once per crawl session (across all nodes).

oncePerSession(String, Runnable) - Method in class com.norconex.crawler.core.session.CrawlerSession

oncePerSessionAndGet(String, Supplier<T>) - Method in class com.norconex.crawler.core.session.CrawlerRunCoordinator

Computes a value exactly once per crawl session (across all nodes) and returns the cached result on subsequent calls.

oncePerSessionAndGet(String, Supplier<T>) - Method in class com.norconex.crawler.core.session.CrawlerSession

OnCommitFailure() - Constructor for class com.norconex.committer.core.batch.queue.impl.FsQueueConfig.OnCommitFailure

onCoordinatorChange(boolean) - Method in interface com.norconex.crawler.core.cluster.impl.hazelcast.event.CoordinatorChangeListener

Invoked when the coordinator changes, only if it means this node either becomes the coordinator, or stop being the coordinator.

onCrawlerCleanBegin(CrawlerEvent) - Method in class com.norconex.crawler.core.event.listeners.CrawlerLifeCycleListener

onCrawlerCleanBegin(CrawlerEvent) - Method in class com.norconex.crawler.web.doc.operations.sitemap.impl.GenericSitemapResolver

onCrawlerCleanEnd(CrawlerEvent) - Method in class com.norconex.crawler.core.event.listeners.CrawlerLifeCycleListener

onCrawlerCrawlBegin(CrawlerEvent) - Method in class com.norconex.crawler.core.event.listeners.CrawlerLifeCycleListener

onCrawlerCrawlBegin(CrawlerEvent) - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolver

onCrawlerCrawlBegin(CrawlerEvent) - Method in class com.norconex.crawler.web.doc.operations.robot.impl.StandardRobotsTxtProvider

onCrawlerCrawlBegin(CrawlerEvent) - Method in class com.norconex.crawler.web.doc.operations.scope.impl.GenericUrlScopeResolver

onCrawlerCrawlBegin(CrawlerEvent) - Method in class com.norconex.crawler.web.doc.operations.sitemap.impl.GenericSitemapResolver

onCrawlerCrawlEnd(CrawlerEvent) - Method in class com.norconex.crawler.core.event.listeners.CrawlerLifeCycleListener

onCrawlerError(CrawlerEvent) - Method in class com.norconex.crawler.core.event.listeners.CrawlerLifeCycleListener

onCrawlerEvent(CrawlerEvent) - Method in class com.norconex.crawler.core.event.listeners.CrawlerLifeCycleListener

onCrawlerStopBegin(CrawlerEvent) - Method in class com.norconex.crawler.core.event.listeners.CrawlerLifeCycleListener

onCrawlerStopBegin(CrawlerEvent) - Method in class com.norconex.crawler.web.doc.operations.sitemap.impl.GenericSitemapResolver

onCrawlerStopEnd(CrawlerEvent) - Method in class com.norconex.crawler.core.event.listeners.CrawlerLifeCycleListener

ONE - Enum constant in enum class com.norconex.committer.core.batch.queue.impl.FsQueue.SplitBatch

onEntryChanged(String, T) - Method in interface com.norconex.crawler.core.cluster.impl.hazelcast.event.CacheEntryChangeListener

Only references - Search tag in class com.norconex.crawler.core.event.listeners.DeleteRejectedEventListener

Section

OnMatch - Enum Class in com.norconex.crawler.core.doc.operations.filter

Constants indicating the action to perform upon matching a condition.

OnMatchFilter - Interface in com.norconex.crawler.core.doc.operations.filter

Tells the collector that a filter is of "OnMatch" type.

OnMatchFiltersResolver<S,F> - Class in com.norconex.crawler.core.doc.pipelines

Runs the predicate against each list items and return true if all entries are accepted, or if there are items implementing OnMatchFilter, if at least one of them is "included".

OnMatchFiltersResolver.OnMatchFiltersResolverBuilder<S,F> - Class in com.norconex.crawler.core.doc.pipelines

onRejected(BiConsumer<List<F>, String>) - Method in class com.norconex.crawler.core.doc.pipelines.OnMatchFiltersResolver.OnMatchFiltersResolverBuilder

Optional callback.

onRejected(Consumer<T>) - Method in class com.norconex.crawler.core.doc.operations.filter.FilterGroupResolver.FilterGroupResolverBuilder

onRejectedNoInclude(Consumer<Collection<T>>) - Method in class com.norconex.crawler.core.doc.operations.filter.FilterGroupResolver.FilterGroupResolverBuilder

onSet - Static variable in class com.norconex.importer.handler.transformer.impl.DateFormatTransformerConfig.Fields

OOXML - Enum constant in enum class com.norconex.crawler.fs.fetch.impl.googledrive.GoogleDriveFetcherConfig.NativeDocumentFormatPolicy

open(Path, MVStoreClusterConnectorConfig) - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheManager

Opens the MVStore file and prepares caches.

OPERA - Enum constant in enum class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverBrowser

OPTIONAL - Enum constant in enum class com.norconex.crawler.core.fetch.FetchDirectiveSupport

ORACLE1_6 - Enum constant in enum class com.norconex.committer.core.fs.impl.CsvFileCommitterConfig.CsvFormat

ORIGINAL_REFERENCE - Static variable in class com.norconex.crawler.web.doc.WebDocMetadata

orphan - Static variable in class com.norconex.crawler.core.ledger.CrawlerEntry.Fields

Orphan documents - Search tag in class com.norconex.crawler.web.WebCrawlerConfig

Section

orphansStrategy - Static variable in class com.norconex.crawler.core.CrawlerConfig.Fields

out() - Method in class com.norconex.crawler.core.cli.CliBase

out(CachedOutputStream) - Method in class com.norconex.importer.handler.DocHandlerContext.DocHandlerContextBuilder

out(String) - Static method in class com.norconex.crawler.web.doc.operations.scope.UrlScope

outOfScopeReason() - Method in class com.norconex.crawler.web.doc.operations.scope.UrlScope

output() - Method in class com.norconex.importer.handler.DocHandlerContext

Make sure to close the stream when done or explictly flush the stream.

Output location - Search tag in class com.norconex.crawler.web.event.listeners.UrlStatusCrawlerEventListener

Section

OUTSCOPE - Enum constant in enum class com.norconex.crawler.web.WebCrawlerConfig.ReferencedLinkType

OWNERS - Enum constant in enum class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.AclTarget

P

pageSegMode - Static variable in class com.norconex.importer.handler.parser.impl.OcrConfig.Fields

pageSeparator - Static variable in class com.norconex.importer.handler.parser.impl.OcrConfig.Fields

PARAM_REQUEST_ID - Static variable in class com.norconex.crawler.web.fetch.impl.webdriver.HttpSniffer

PARENT_OVERRIDE - Enum constant in enum class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.AclInheritanceType

parentReferences() - Method in class com.norconex.importer.handler.DocHandlerContext

parse(InputStream, ContentHandler, Metadata, ParseContext) - Method in class com.norconex.importer.handler.parser.impl.XfdlTikaParser

parse(String) - Static method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyPath

parse(String, String, String, String) - Static method in class com.norconex.crawler.fs.fetch.impl.FolderItemReferenceParser

Parsed(FolderItemReferenceParser.Kind, String, String, String) - Constructor for record class com.norconex.crawler.fs.fetch.impl.FolderItemReferenceParser.Parsed

Creates an instance of a Parsed record class.

parseDomAttributes(String) - Static method in class com.norconex.crawler.web.util.Web

Parses a string containing one or more HTML/XML attributes (e.g., key="value") and returns them all.

parseDomAttributes(String, boolean) - Static method in class com.norconex.crawler.web.util.Web

Parses a string containing one or more HTML/XML attributes (e.g., key="value") and returns them all.

PARSER_HTML - Static variable in class com.norconex.importer.util.DomUtil

PARSER_XML - Static variable in class com.norconex.importer.util.DomUtil

parseRobotsTxt(InputStream, String, String) - Method in class com.norconex.crawler.web.doc.operations.robot.impl.StandardRobotsTxtProvider

parseState() - Method in class com.norconex.importer.handler.DocHandlerContext

parseState(ParseState) - Method in class com.norconex.importer.handler.DocHandlerContext.DocHandlerContextBuilder

parseState(ParseState) - Method in class com.norconex.importer.handler.DocHandlerContext

parseState(ParseState) - Method in class com.norconex.importer.ImporterEvent.ImporterEventBuilder

Gets the document parse state (never null).

ParseState - Enum Class in com.norconex.importer.handler.parser

Act as a flag indicating if a document has been parsed or not in a given process flow.

PARTIALLINKTEXT - Enum constant in enum class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcherConfig.WaitElementType

Locate by partial visible link text.

PARTIALLINKTEXT - Enum constant in enum class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig.WaitElementType

PATH - Static variable in class com.norconex.crawler.fs.doc.FsDocMetadata

paths - Static variable in class com.norconex.crawler.web.doc.operations.sitemap.impl.GenericSitemapLocatorConfig.Fields

PDF - Enum constant in enum class com.norconex.crawler.fs.fetch.impl.googledrive.GoogleDriveFetcherConfig.NativeDocumentFormatPolicy

PdfPageSplitter - Class in com.norconex.importer.handler.splitter.impl

Split PDFs pages so each pages are treated as individual documents.

PdfPageSplitter() - Constructor for class com.norconex.importer.handler.splitter.impl.PdfPageSplitter

PdfPageSplitterConfig - Class in com.norconex.importer.handler.splitter.impl

Split PDFs pages so each pages are treated as individual documents.

PdfPageSplitterConfig() - Constructor for class com.norconex.importer.handler.splitter.impl.PdfPageSplitterConfig

PENDING - Enum constant in enum class com.norconex.crawler.core.cluster.pipeline.PipelineStatus

PIPE_CURRENT_STEP - Static variable in class com.norconex.crawler.core.cluster.CacheNames

PIPE_WORKER_STATUSES - Static variable in class com.norconex.crawler.core.cluster.CacheNames

Pipeline - Class in com.norconex.crawler.core.cluster.pipeline

Pipeline(String) - Constructor for class com.norconex.crawler.core.cluster.pipeline.Pipeline

Pipeline(String, List<Step>) - Constructor for class com.norconex.crawler.core.cluster.pipeline.Pipeline

PipelineCoordinator - Class in com.norconex.crawler.core.cluster.impl.hazelcast.pipeline

PipelineCoordinator(HazelcastCluster, Pipeline) - Constructor for class com.norconex.crawler.core.cluster.impl.hazelcast.pipeline.PipelineCoordinator

PipelineCoordinatorState - Class in com.norconex.crawler.core.cluster.impl.hazelcast.pipeline

PipelineCoordinatorState(HazelcastCluster, Pipeline) - Constructor for class com.norconex.crawler.core.cluster.impl.hazelcast.pipeline.PipelineCoordinatorState

PipelineException - Exception Class in com.norconex.crawler.core.cluster.pipeline

Runtime exception for cache-related errors.

PipelineException() - Constructor for exception class com.norconex.crawler.core.cluster.pipeline.PipelineException

PipelineException(String) - Constructor for exception class com.norconex.crawler.core.cluster.pipeline.PipelineException

PipelineException(String, Throwable) - Constructor for exception class com.norconex.crawler.core.cluster.pipeline.PipelineException

PipelineException(Throwable) - Constructor for exception class com.norconex.crawler.core.cluster.pipeline.PipelineException

PipelineExecution - Class in com.norconex.crawler.core.cluster.impl.hazelcast.pipeline

Execute a worker and, if applicable, a coordinator to execute a pipeline.

PipelineExecution(HazelcastCluster, Pipeline) - Constructor for class com.norconex.crawler.core.cluster.impl.hazelcast.pipeline.PipelineExecution

pipelineId(String) - Method in class com.norconex.crawler.core.cluster.pipeline.PipelineResult.PipelineResultBuilder

pipelineKey(HazelcastCluster, Pipeline) - Static method in class com.norconex.crawler.core.cluster.impl.hazelcast.CacheKeys

PipelineManager - Interface in com.norconex.crawler.core.cluster.pipeline

Responsible for pipeline execution.

PipelineProgress - Class in com.norconex.crawler.core.cluster.pipeline

Snapshot representation a the pipeline progress.

PipelineProgress.PipelineProgressBuilder - Class in com.norconex.crawler.core.cluster.pipeline

PipelineProgressBean - Class in com.norconex.crawler.core.cluster.pipeline

MXBean implementation delegating to PipelineManager#getPipelineProgress.

PipelineProgressBean(PipelineManager, String) - Constructor for class com.norconex.crawler.core.cluster.pipeline.PipelineProgressBean

PipelineProgressJMX - Class in com.norconex.crawler.core.cluster.pipeline

Registrar for the coordinator-only PipelineProgress MXBean.

PipelineProgressMXBean - Interface in com.norconex.crawler.core.cluster.pipeline

MXBean exposing cluster-wide pipeline progress (coordinator view).

PipelineResult - Class in com.norconex.crawler.core.cluster.pipeline

Result summary of a pipeline execution.

PipelineResult.PipelineResultBuilder - Class in com.norconex.crawler.core.cluster.pipeline

PipelineStatus - Enum Class in com.norconex.crawler.core.cluster.pipeline

PipelineTerminationTracker - Class in com.norconex.crawler.core.cluster.impl.hazelcast.pipeline

For workers to know when a pipeline has terminated.

PipelineTerminationTracker(HazelcastCluster, Pipeline, PipelineWorkerState) - Constructor for class com.norconex.crawler.core.cluster.impl.hazelcast.pipeline.PipelineTerminationTracker

PipelineWorker - Class in com.norconex.crawler.core.cluster.impl.hazelcast.pipeline

PipelineWorker(HazelcastCluster, Pipeline) - Constructor for class com.norconex.crawler.core.cluster.impl.hazelcast.pipeline.PipelineWorker

pipelineWorkerKeyPrefix(HazelcastCluster, Pipeline) - Static method in class com.norconex.crawler.core.cluster.impl.hazelcast.CacheKeys

The worker key without the node information, constructed as:

pipelineWorkerNodeKey(HazelcastCluster, Pipeline) - Static method in class com.norconex.crawler.core.cluster.impl.hazelcast.CacheKeys

PipelineWorkerState - Class in com.norconex.crawler.core.cluster.impl.hazelcast.pipeline

PipelineWorkerState(HazelcastCluster, Pipeline, Consumer<StepRecord>) - Constructor for class com.norconex.crawler.core.cluster.impl.hazelcast.pipeline.PipelineWorkerState

PlaywrightBrowser - Enum Class in com.norconex.crawler.web.fetch.impl.playwright

Playwright-supported browser engines.

PlaywrightFetcher - Class in com.norconex.crawler.web.fetch.impl.playwright

Uses Microsoft Playwright for browser-based crawling.

PlaywrightFetcher() - Constructor for class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcher

PlaywrightFetcherConfig - Class in com.norconex.crawler.web.fetch.impl.playwright

Configuration for PlaywrightFetcher.

PlaywrightFetcherConfig() - Constructor for class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcherConfig

PlaywrightFetcherConfig.WaitElementType - Enum Class in com.norconex.crawler.web.fetch.impl.playwright

Element locator strategy for PlaywrightFetcherConfig.getWaitForElementSelector().

PlaywrightScreenshotHandler - Class in com.norconex.crawler.web.fetch.impl.playwright

Takes screenshots of pages using a Playwright Page.

PlaywrightScreenshotHandler() - Constructor for class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightScreenshotHandler

PlaywrightScreenshotHandler(CachedStreamFactory) - Constructor for class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightScreenshotHandler

poll() - Method in interface com.norconex.crawler.core.cluster.CacheQueue

poll() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastQueueAdapter

poll() - Method in class com.norconex.crawler.core.cluster.impl.memory.InMemoryCacheQueue

poll() - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheQueue

pollBatch(int) - Method in interface com.norconex.crawler.core.cluster.CacheQueue

pollBatch(int) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastQueueAdapter

pollBatch(int) - Method in class com.norconex.crawler.core.cluster.impl.memory.InMemoryCacheQueue

pollBatch(int) - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheQueue

POST - Enum constant in enum class com.norconex.crawler.web.fetch.HttpMethod

POST - Enum constant in enum class com.norconex.importer.handler.parser.ParseState

POSTGRESSQL_CSV1_5 - Enum constant in enum class com.norconex.committer.core.fs.impl.CsvFileCommitterConfig.CsvFormat

POSTGRESSQL_TEXT1_5 - Enum constant in enum class com.norconex.committer.core.fs.impl.CsvFileCommitterConfig.CsvFormat

postImportConsumers - Static variable in class com.norconex.crawler.core.CrawlerConfig.Fields

postImportLinks - Static variable in class com.norconex.crawler.web.WebCrawlerConfig.Fields

postImportLinksKeep - Static variable in class com.norconex.crawler.web.WebCrawlerConfig.Fields

PostImportLinksStage - Class in com.norconex.crawler.web.doc.pipelines.committer.stages

Queue for crawling URLs from matching metadata fields, if any.

PostImportLinksStage() - Constructor for class com.norconex.crawler.web.doc.pipelines.committer.stages.PostImportLinksStage

PRE - Enum constant in enum class com.norconex.importer.handler.parser.ParseState

predicate(BiPredicate<S, F>) - Method in class com.norconex.crawler.core.doc.pipelines.OnMatchFiltersResolver.OnMatchFiltersResolverBuilder

Predicate matching a filter against the subject.

preemptive - Static variable in class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthConfig.Fields

PREFIX - Static variable in class com.norconex.crawler.core.doc.CrawlerDocMetaConstants

preImportConsumers - Static variable in class com.norconex.crawler.core.CrawlerConfig.Fields

PREMATURE - Static variable in class com.norconex.crawler.core.ledger.ProcessingOutcome

For collectors that support it, this state indicates a previously crawled document is not yet ready to be re-crawled.

PRESENT - Enum constant in enum class com.norconex.crawler.web.doc.operations.scope.UrlScopeResolver.SitemapPresence

preserveInterwordSpacing - Static variable in class com.norconex.importer.handler.parser.impl.OcrConfig.Fields

previousCrawlEntry(CrawlerEntry) - Method in class com.norconex.crawler.core.doc.CrawlerDocContext.CrawlerDocContextBuilder

priorityCharset() - Method in class com.norconex.importer.charset.CharsetDetector.CharsetDetectorBuilder

priorityCharset(Supplier<Object>) - Method in class com.norconex.importer.charset.CharsetDetector.CharsetDetectorBuilder

Pro-active change detection - Search tag in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcher

Section

PROCESS - Enum constant in enum class com.norconex.crawler.core.CrawlerConfig.OrphansStrategy

Processing orphans tries to obtain and process them again, normally.

PROCESSED - Enum constant in enum class com.norconex.crawler.core.ledger.ProcessingStatus

Processing completed a crawl entry.

processedAt - Static variable in class com.norconex.crawler.core.ledger.CrawlerEntry.Fields

processImporterResponse(ImporterResponse) - Method in interface com.norconex.importer.response.ImporterResponseProcessor

Processes the importer response.

PROCESSING - Enum constant in enum class com.norconex.crawler.core.ledger.ProcessingStatus

Processing started but did not yet finish or failed.

processingAt - Static variable in class com.norconex.crawler.core.ledger.CrawlerEntry.Fields

processingOutcome - Static variable in class com.norconex.crawler.core.ledger.CrawlerEntry.Fields

processingOutcome(ProcessingOutcome) - Method in class com.norconex.crawler.fs.fetch.impl.GenericFileFetchResponse.GenericFileFetchResponseBuilder

processingOutcome(ProcessingOutcome) - Method in class com.norconex.crawler.fs.fetch.impl.GenericFolderPathsFetchResponse.GenericFolderPathsFetchResponseBuilder

processingOutcome(ProcessingOutcome) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetchResponse.HttpClientFetchResponseBuilder

ProcessingOutcome - Class in com.norconex.crawler.core.ledger

Reference processing status.

ProcessingOutcome(String) - Constructor for class com.norconex.crawler.core.ledger.ProcessingOutcome

Constructor.

processingStatus - Static variable in class com.norconex.crawler.core.ledger.CrawlerEntry.Fields

ProcessingStatus - Enum Class in com.norconex.crawler.core.ledger

The different stages of a crawl entry processing life-cycle: UNTRACKED -> QUEUED -> PROCESSING -> PROCESSED

PROP_DATA_CONN_REF - Static variable in class com.norconex.crawler.core.cluster.impl.hazelcast.jdbc.JdbcClient

PROP_TABLE_NAME - Static variable in class com.norconex.crawler.core.cluster.impl.hazelcast.jdbc.JdbcClient

Provided Scripting Languages - Search tag in class com.norconex.importer.handler.ScriptRunner

Section

provideRedirectURL(HttpRequest, HttpResponse, HttpContext) - Method in class com.norconex.crawler.web.fetch.util.GenericRedirectUrlProvider

provideRedirectURL(HttpRequest, HttpResponse, HttpContext) - Method in interface com.norconex.crawler.web.fetch.util.RedirectUrlProvider

Provides the redirect URL that the crawler must follow.

provideReferences() - Method in interface com.norconex.crawler.core.doc.pipelines.queue.ReferencesProvider

Provides an iterator over provided references.

pushPipelineStatus(PipelineStatus) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.pipeline.PipelineCoordinatorState

pushSolrRequest(UpdateRequest) - Method in class com.norconex.committer.solr.SolrCommitter

pushWorkerStatus(PipelineStatus) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.pipeline.PipelineWorkerState

put(String, T) - Method in interface com.norconex.crawler.core.cluster.CacheMap

put(String, T) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastMapAdapter

put(String, T) - Method in class com.norconex.crawler.core.cluster.impl.memory.InMemoryCacheMap

put(String, T) - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheMap

putAll(Map<String, T>) - Method in interface com.norconex.crawler.core.cluster.CacheMap

putAll(Map<String, T>) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastMapAdapter

putAll(Map<String, T>) - Method in class com.norconex.crawler.core.cluster.impl.memory.InMemoryCacheMap

putAll(Map<String, T>) - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheMap

putIfAbsent(String, T) - Method in interface com.norconex.crawler.core.cluster.CacheMap

If the specified key is not already associated with a value, associates it with the given value.

putIfAbsent(String, T) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastMapAdapter

putIfAbsent(String, T) - Method in class com.norconex.crawler.core.cluster.impl.memory.InMemoryCacheMap

putIfAbsent(String, T) - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheMap

Q

query(QueryFilter) - Method in interface com.norconex.crawler.core.cluster.CacheMap

Queries the cache for entries matching the given query filter.

query(QueryFilter) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastMapAdapter

query(QueryFilter) - Method in class com.norconex.crawler.core.cluster.impl.memory.InMemoryCacheMap

query(QueryFilter) - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheMap

QueryFilter - Class in com.norconex.crawler.core.cluster

Very simple cache entry expression.

queryIterator(QueryFilter) - Method in interface com.norconex.crawler.core.cluster.CacheMap

Queries the cache for entries matching the given filter and returns an iterator for memory-efficient processing of results.

queryIterator(QueryFilter) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastMapAdapter

queryIterator(QueryFilter) - Method in class com.norconex.crawler.core.cluster.impl.memory.InMemoryCacheMap

queryIterator(QueryFilter) - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheMap

queue(CommitterRequest) - Method in interface com.norconex.committer.core.batch.queue.CommitterQueue

Queues a committer request to be later processed in batch.

queue(CommitterRequest) - Method in class com.norconex.committer.core.batch.queue.impl.FsQueue

queue(CrawlerEntry) - Method in class com.norconex.crawler.core.cmd.crawl.pipeline.bootstrap.queue.QueueBootstrapContext

queue(CrawlerEntry) - Method in class com.norconex.crawler.core.ledger.CrawlerEntryLedger

queue(String) - Method in class com.norconex.crawler.core.cmd.crawl.pipeline.bootstrap.queue.QueueBootstrapContext

QUEUE - Enum constant in enum class com.norconex.crawler.core.cluster.SerializedCache.CacheType

QUEUE_STORE_FACTORY_CLASS - Static variable in class com.norconex.crawler.core.cluster.impl.hazelcast.JdbcHazelcastConfigurer

Factory class for JDBC-backed queue stores.

QueueBootstrapContext - Class in com.norconex.crawler.core.cmd.crawl.pipeline.bootstrap.queue

Holds contextual objects necessary to initialize a crawler queue.

QueueBootstrapContext(CrawlerSession, Consumer<CrawlerEntry>) - Constructor for class com.norconex.crawler.core.cmd.crawl.pipeline.bootstrap.queue.QueueBootstrapContext

QueueBootstrapper - Class in com.norconex.crawler.core.cmd.crawl.pipeline.bootstrap.queue

Default queue initializer, feeding the queue from a mix of reference enqueuers.

QueueBootstrapper() - Constructor for class com.norconex.crawler.core.cmd.crawl.pipeline.bootstrap.queue.QueueBootstrapper

QueueBootstrapper(List<ReferenceEnqueuer>) - Constructor for class com.norconex.crawler.core.cmd.crawl.pipeline.bootstrap.queue.QueueBootstrapper

QUEUED - Enum constant in enum class com.norconex.crawler.core.ledger.ProcessingStatus

Queued in ledger for processing.

queuedAt - Static variable in class com.norconex.crawler.core.ledger.CrawlerEntry.Fields

queuePipeline(QueuePipeline) - Method in class com.norconex.crawler.core.doc.pipelines.CrawlerDocPipelines.CrawlerDocPipelinesBuilder

QueuePipeline - Class in com.norconex.crawler.core.doc.pipelines.queue

QueuePipeline.QueuePipelineBuilder - Class in com.norconex.crawler.core.doc.pipelines.queue

QueuePipelineContext - Class in com.norconex.crawler.core.doc.pipelines.queue

Hold necessary objects to a specific pipeline execution over a CrawlerDocContext.

QueuePipelineContext(CrawlerSession, CrawlerEntry) - Constructor for class com.norconex.crawler.core.doc.pipelines.queue.QueuePipelineContext

queueRedirectURL(ImporterPipelineContext, WebFetchResponse, String) - Static method in class com.norconex.crawler.web.doc.pipelines.importer.WebImporterPipelineUtil

QueueReferenceStage - Class in com.norconex.crawler.core.doc.pipelines.queue.stages

Common pipeline stage for queuing documents.

QueueReferenceStage() - Constructor for class com.norconex.crawler.core.doc.pipelines.queue.stages.QueueReferenceStage

quitDriver() - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverManager

Explicitly quit and remove the current thread's driver (optional — the driver manager will cleanup instances that were used by dead threads).

quote - Static variable in class com.norconex.committer.core.fs.impl.CsvFileCommitterConfig.Fields

R

RAW - Enum constant in enum class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.UploadFormat

Upload the original, unparsed binary content (captured in the "binaryContent" metadata field, e.g., by a BinaryContentTransformer pre-parse handler).

rawFileSystem() - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyPath

Raw vs text upload - Search tag in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitter

Section

read(CompactReader) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.JacksonCompactSerializer

read(CompactReader) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.StepRecordCompactSerializer

read(DocHandlerContext, FailableFunction<TextChunk, Boolean, IOException>) - Method in class com.norconex.importer.util.chunk.ChunkedTextReader

Handles the processing of document text, invoking the consumer as many times as necessary.

ReadAdapter - Class in com.norconex.importer.util

ReadAdapter(InputStream) - Constructor for class com.norconex.importer.util.ReadAdapter

ReadAdapter(Supplier<InputStream>) - Constructor for class com.norconex.importer.util.ReadAdapter

ReadAdapter(Supplier<InputStream>, Charset) - Constructor for class com.norconex.importer.util.ReadAdapter

ReadAdapter.ChunkedReadOptions - Class in com.norconex.importer.util

readAttributes(Path, String, LinkOption...) - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyFileSystemProvider

READERS - Enum constant in enum class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.AclTarget

ReadOnlyFileAttributes - Class in com.norconex.crawler.fs.fetch.impl

Shared read-only BasicFileAttributes behavior for remote file systems that only differentiate between regular files and directories.

ReadOnlyFileAttributes(boolean, long, FileTime) - Constructor for class com.norconex.crawler.fs.fetch.impl.ReadOnlyFileAttributes

ReadOnlyFileAttributes(boolean, long, FileTime, FileTime) - Constructor for class com.norconex.crawler.fs.fetch.impl.ReadOnlyFileAttributes

ReadOnlyFileSystem - Class in com.norconex.crawler.fs.fetch.impl

Shared behavior for read-only NIO.2 file systems backed by remote storage/providers.

ReadOnlyFileSystem(String) - Constructor for class com.norconex.crawler.fs.fetch.impl.ReadOnlyFileSystem

ReadOnlyFileSystemProvider - Class in com.norconex.crawler.fs.fetch.impl

Common read-only FileSystemProvider behavior shared by cloud and remote filesystem providers.

ReadOnlyFileSystemProvider() - Constructor for class com.norconex.crawler.fs.fetch.impl.ReadOnlyFileSystemProvider

ReadOnlyPath - Class in com.norconex.crawler.fs.fetch.impl

Shared absolute-path behavior for remote, read-only file systems.

ReadOnlyPath(FileSystem, List<String>, String) - Constructor for class com.norconex.crawler.fs.fetch.impl.ReadOnlyPath

realm - Static variable in class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthConfig.Fields

reasonPhrase(String) - Method in class com.norconex.crawler.fs.fetch.impl.GenericFileFetchResponse.GenericFileFetchResponseBuilder

reasonPhrase(String) - Method in class com.norconex.crawler.fs.fetch.impl.GenericFolderPathsFetchResponse.GenericFolderPathsFetchResponseBuilder

reasonPhrase(String) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetchResponse.HttpClientFetchResponseBuilder

recrawlableResolver - Static variable in class com.norconex.crawler.web.WebCrawlerConfig.Fields

RecrawlableResolver - Interface in com.norconex.crawler.web.doc.operations.recrawl

Indicates whether a document that was successfully crawled on a previous crawling session should be recrawled or not.

RecrawlableResolverStage - Class in com.norconex.crawler.web.doc.pipelines.importer.stages

Determines whether to recrawl a document or not.

RecrawlableResolverStage() - Constructor for class com.norconex.crawler.web.doc.pipelines.importer.stages.RecrawlableResolverStage

Re-crawl Frequency - Search tag in class com.norconex.crawler.web.WebCrawlerConfig

Section

REDIRECT - Static variable in class com.norconex.crawler.web.doc.WebProcessingOutcome

REDIRECT_TRAIL - Static variable in class com.norconex.crawler.web.doc.WebDocMetadata

redirectTarget(String) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetchResponse.HttpClientFetchResponseBuilder

RedirectUrlProvider - Interface in com.norconex.crawler.web.fetch.util

Responsible for providing a target absolute URL each time an HTTP redirect is encountered when invoking a URL.

reduce(CrawlerSession, Bag<PipelineStatus>) - Method in class com.norconex.crawler.core.cluster.pipeline.BaseStep

reduce(CrawlerSession, Bag<PipelineStatus>) - Method in interface com.norconex.crawler.core.cluster.pipeline.Step

reference - Static variable in class com.norconex.crawler.core.ledger.CrawlerEntry.Fields

reference() - Method in class com.norconex.importer.handler.DocHandlerContext

REFERENCE - Enum constant in enum class com.norconex.crawler.web.doc.operations.recrawl.impl.GenericRecrawlableResolverConfig.MinFrequency.ApplyTo

REFERENCE - Static variable in class com.norconex.importer.doc.DocMetaConstants

Document unique reference (also called "id", "primary key", etc.).

REFERENCE_QUEUE - Static variable in class com.norconex.crawler.core.cluster.CacheNames

ReferenceCondition - Class in com.norconex.importer.handler.condition.impl

A condition based on a text pattern matching a document reference (e.g.

ReferenceCondition() - Constructor for class com.norconex.importer.handler.condition.impl.ReferenceCondition

ReferenceCondition(TextMatcher) - Constructor for class com.norconex.importer.handler.condition.impl.ReferenceCondition

ReferenceConditionConfig - Class in com.norconex.importer.handler.condition.impl

A condition based on a text pattern matching a document reference (e.g.

ReferenceConditionConfig() - Constructor for class com.norconex.importer.handler.condition.impl.ReferenceConditionConfig

REFERENCED_URLS - Static variable in class com.norconex.crawler.web.doc.WebDocMetadata

REFERENCED_URLS_OUT_OF_SCOPE - Static variable in class com.norconex.crawler.web.doc.WebDocMetadata

ReferenceDelayResolver - Class in com.norconex.crawler.web.doc.operations.delay.impl

Introduces different delays between document downloads based on matching document reference (URL) patterns.

ReferenceDelayResolver() - Constructor for class com.norconex.crawler.web.doc.operations.delay.impl.ReferenceDelayResolver

ReferenceDelayResolverConfig - Class in com.norconex.crawler.web.doc.operations.delay.impl

Configuration for ReferenceDelayResolver.

ReferenceDelayResolverConfig() - Constructor for class com.norconex.crawler.web.doc.operations.delay.impl.ReferenceDelayResolverConfig

ReferenceEnqueuer - Interface in com.norconex.crawler.core.cmd.crawl.pipeline.bootstrap.queue

Provides initial references to be store in the queue for crawling.

ReferenceFilter - Interface in com.norconex.crawler.core.doc.operations.filter

Filter a document based on its reference, before its properties or content gets read or otherwise acquired.

referenceFilters - Static variable in class com.norconex.crawler.core.CrawlerConfig.Fields

ReferenceFiltersStage - Class in com.norconex.crawler.core.doc.pipelines.queue.stages

Common pipeline stage for filtering references.

ReferenceFiltersStage() - Constructor for class com.norconex.crawler.core.doc.pipelines.queue.stages.ReferenceFiltersStage

ReferenceFiltersStage(String) - Constructor for class com.norconex.crawler.core.doc.pipelines.queue.stages.ReferenceFiltersStage

ReferencesProvider - Interface in com.norconex.crawler.core.doc.pipelines.queue

Provide references for crawling.

referenceStartsWith(FetchRequest, String...) - Static method in class com.norconex.crawler.fs.fetch.impl.FileFetchUtil

Whether a reference starts with any of the given prefixes (typically URI schemes).

referenceTrail - Static variable in class com.norconex.crawler.core.ledger.CrawlerEntry.Fields

REFERRER_LINK_PREFIX - Static variable in class com.norconex.crawler.web.doc.WebDocMetadata

REFERRER_REFERENCE - Static variable in class com.norconex.crawler.web.doc.WebDocMetadata

Referrer data - Search tag in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractor

Section

Referrer data - Search tag in class com.norconex.crawler.web.doc.operations.link.impl.RegexLinkExtractor

Section

Referrer data - Search tag in class com.norconex.crawler.web.doc.operations.link.impl.XmlFeedLinkExtractor

Section

Referring/parent URLs and custom link extractor - Search tag in class com.norconex.crawler.web.event.listeners.UrlStatusCrawlerEventListener

Section

RefFileEnqueuer - Class in com.norconex.crawler.core.cmd.crawl.pipeline.bootstrap.queue

Enqueues references from files obtained from the crawler configuration CrawlerConfig.getStartReferencesFiles().

RefFileEnqueuer() - Constructor for class com.norconex.crawler.core.cmd.crawl.pipeline.bootstrap.queue.RefFileEnqueuer

RefListEnqueuer - Class in com.norconex.crawler.core.cmd.crawl.pipeline.bootstrap.queue

Enqueues references from a list obtained from the crawler configuration CrawlerConfig.getStartReferences().

RefListEnqueuer() - Constructor for class com.norconex.crawler.core.cmd.crawl.pipeline.bootstrap.queue.RefListEnqueuer

RefProviderEnqueuer - Class in com.norconex.crawler.core.cmd.crawl.pipeline.bootstrap.queue

Enqueues references from files obtained from the crawler configuration CrawlerConfig.getStartReferencesProviders().

RefProviderEnqueuer() - Constructor for class com.norconex.crawler.core.cmd.crawl.pipeline.bootstrap.queue.RefProviderEnqueuer

RegexLinkExtractor - Class in com.norconex.crawler.web.doc.operations.link.impl

Link extractor using regular expressions to extract links found in text documents.

RegexLinkExtractor() - Constructor for class com.norconex.crawler.web.doc.operations.link.impl.RegexLinkExtractor

RegexLinkExtractorConfig - Class in com.norconex.crawler.web.doc.operations.link.impl

Configuration for RegexLinkExtractor.

RegexLinkExtractorConfig() - Constructor for class com.norconex.crawler.web.doc.operations.link.impl.RegexLinkExtractorConfig

RegexLinkExtractorConfig.ExtractionPattern - Class in com.norconex.crawler.web.doc.operations.link.impl

RegexPair(String, String, boolean) - Constructor for class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractorConfig.RegexPair

RegexTransformer - Class in com.norconex.importer.handler.transformer.impl

Extracts field names and their values with regular expression.

RegexTransformer() - Constructor for class com.norconex.importer.handler.transformer.impl.RegexTransformer

RegexTransformerConfig - Class in com.norconex.importer.handler.transformer.impl

Extracts field names and their values with regular expression.

RegexTransformerConfig() - Constructor for class com.norconex.importer.handler.transformer.impl.RegexTransformerConfig

register(BasePolymorphicTypeProvider.Registry) - Method in class com.norconex.crawler.core.spi.CrawlerCorePtProvider

register(BasePolymorphicTypeProvider.Registry) - Method in class com.norconex.crawler.fs.spi.CrawlerFsPtProvider

register(CrawlerContext) - Static method in class com.norconex.crawler.core.metrics.CrawlerMetricsJMX

register(CrawlerContext, PipelineManager, String) - Static method in class com.norconex.crawler.core.cluster.pipeline.PipelineProgressJMX

register(WatchService, WatchEvent.Kind<?>[], WatchEvent.Modifier...) - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyPath

registerStepListener() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.pipeline.PipelineWorkerState

Registers the step listener.

Reject - Class in com.norconex.importer.handler

Special handler that marks a document as being "rejected", with an optional custom message for event logging.

Reject() - Constructor for class com.norconex.importer.handler.Reject

RejectConfig - Class in com.norconex.importer.handler

RejectConfig() - Constructor for class com.norconex.importer.handler.RejectConfig

REJECTED - Enum constant in enum class com.norconex.importer.response.ImporterResponse.Status

REJECTED - Static variable in class com.norconex.crawler.core.ledger.ProcessingOutcome

REJECTED_BAD_STATUS - Static variable in class com.norconex.crawler.core.event.CrawlerEvent

A document was rejected because the status obtained when trying to obtain it was not accepted (e.g., 500 HTTP error code).

REJECTED_DUPLICATE - Static variable in class com.norconex.crawler.core.event.CrawlerEvent

A document was rejected since another document with a different reference was already processed with the same digital signature ( checksum).

REJECTED_ERROR - Static variable in class com.norconex.crawler.core.event.CrawlerEvent

A document was rejected because an error occurred when processing it.

REJECTED_FILTER - Static variable in class com.norconex.crawler.core.event.CrawlerEvent

A document was rejected by a filters.

REJECTED_IMPORT - Static variable in class com.norconex.crawler.core.event.CrawlerEvent

A document was rejected by the Importer module.

REJECTED_NONCANONICAL - Static variable in class com.norconex.crawler.web.event.WebCrawlerEvent

REJECTED_NOTFOUND - Static variable in class com.norconex.crawler.core.event.CrawlerEvent

A document was rejected because it could not be found (e.g., no longer exists at a given location).

REJECTED_OUT_OF_SCOPE - Static variable in class com.norconex.crawler.web.event.WebCrawlerEvent

REJECTED_PREMATURE - Static variable in class com.norconex.crawler.core.event.CrawlerEvent

A document could not be re-crawled because it is not yet ready to be re-crawled.

REJECTED_REDIRECTED - Static variable in class com.norconex.crawler.web.event.WebCrawlerEvent

REJECTED_ROBOTS_META_NOINDEX - Static variable in class com.norconex.crawler.web.event.WebCrawlerEvent

REJECTED_ROBOTS_TXT - Static variable in class com.norconex.crawler.web.event.WebCrawlerEvent

REJECTED_TOO_DEEP - Static variable in class com.norconex.crawler.core.event.CrawlerEvent

A document was rejected because it is located too deep.

REJECTED_UNMODIFIED - Static variable in class com.norconex.crawler.core.event.CrawlerEvent

A document was rejected as it was not modified since last time it was crawled.

rejectedBy() - Method in class com.norconex.importer.handler.DocHandlerContext

rejectedBy(Object) - Method in class com.norconex.importer.handler.DocHandlerContext.DocHandlerContextBuilder

rejectedBy(Object) - Method in class com.norconex.importer.handler.DocHandlerContext

Relative date conditions: - Search tag in class com.norconex.importer.handler.condition.impl.DateCondition

Section

Relative date conditions: - Search tag in class com.norconex.importer.handler.condition.impl.DateConditionConfig

Section

relativize(Path) - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyPath

RELAXED - Enum constant in enum class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig.CookieSpec

remove(String) - Method in interface com.norconex.crawler.core.cluster.CacheMap

remove(String) - Method in interface com.norconex.crawler.core.cluster.CacheSet

remove(String) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastMapAdapter

remove(String) - Method in class com.norconex.crawler.core.cluster.impl.memory.InMemoryCacheMap

remove(String) - Method in class com.norconex.crawler.core.cluster.impl.memory.InMemoryCacheSet

remove(String) - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheMap

remove(String) - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheSet

REMOVE_DEFAULT_PORT - Enum constant in enum class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizerConfig.Normalization

REMOVE_DIRECTORY_INDEX - Enum constant in enum class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizerConfig.Normalization

REMOVE_DOT_SEGMENTS - Enum constant in enum class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizerConfig.Normalization

REMOVE_DUPLICATE_SLASHES - Enum constant in enum class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizerConfig.Normalization

REMOVE_EMPTY_PARAMETERS - Enum constant in enum class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizerConfig.Normalization

REMOVE_FRAGMENT - Enum constant in enum class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizerConfig.Normalization

REMOVE_QUERY_STRING - Enum constant in enum class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizerConfig.Normalization

REMOVE_SESSION_IDS - Enum constant in enum class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizerConfig.Normalization

REMOVE_TRAILING_FRAGMENT - Enum constant in enum class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizerConfig.Normalization

REMOVE_TRAILING_HASH - Enum constant in enum class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizerConfig.Normalization

REMOVE_TRAILING_QUESTION_MARK - Enum constant in enum class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizerConfig.Normalization

REMOVE_TRAILING_SLASH - Enum constant in enum class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizerConfig.Normalization

REMOVE_WWW - Enum constant in enum class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizerConfig.Normalization

removeCacheEntryChangeListener(CacheEntryChangeListener<T>, String) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastCacheManager

removeCacheEntryChangeListener(CacheEntryChangeListener<T>, String) - Method in interface com.norconex.crawler.core.cluster.CacheManager

Removes a cache entry change listener from the specified cache.

removeCacheEntryChangeListener(CacheEntryChangeListener<T>, String) - Method in class com.norconex.crawler.core.cluster.impl.memory.MemoryCacheManager

removeCacheEntryChangeListener(CacheEntryChangeListener<T>, String) - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheManager

removeCoordinatorChangeListener(CoordinatorChangeListener) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastCluster

removeEntry(String) - Method in class com.norconex.crawler.core.ledger.CrawlerEntryLedger

Removes an entry from the ledger, updating the status counters.

removeEventListener(EventListener<?>) - Method in class com.norconex.crawler.core.CrawlerConfig

Removes a single event listener from the list of registered listeners if present.

removeFieldMapping(String) - Method in class com.norconex.committer.core.BaseCommitterConfig

removeLinkSelector(String) - Method in class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractorConfig

removeLinkTag(String, String) - Method in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractorConfig

removeRequest(CommitterRequest) - Method in class com.norconex.committer.core.impl.MemoryCommitter

removeRequestHeader(String) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

Remove the request header matching the given name.

removeRestriction(PropertyMatcher) - Method in class com.norconex.committer.core.BaseCommitterConfig

Removes a restriction.

removeRestriction(String) - Method in class com.norconex.committer.core.BaseCommitterConfig

Removes all restrictions on a given field.

removeStepChangeListener(CacheEntryChangeListener<StepRecord>) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.pipeline.HazelcastPipelineManager

removeStepChangeListener(CacheEntryChangeListener<StepRecord>) - Method in class com.norconex.crawler.core.cluster.impl.memory.LocalPipelineManager

removeStepChangeListener(CacheEntryChangeListener<StepRecord>) - Method in interface com.norconex.crawler.core.cluster.pipeline.PipelineManager

Removes a listener for step changes.

removeWorkerStatusListener(CacheEntryChangeListener<StepRecord>) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.pipeline.HazelcastPipelineManager

removeWorkerStatusListener(CacheEntryChangeListener<StepRecord>) - Method in class com.norconex.crawler.core.cluster.impl.memory.LocalPipelineManager

removeWorkerStatusListener(CacheEntryChangeListener<StepRecord>) - Method in interface com.norconex.crawler.core.cluster.pipeline.PipelineManager

Removes a listener for worker status changes.

RenameOperation - Class in com.norconex.importer.handler.transformer.impl

RenameOperation() - Constructor for class com.norconex.importer.handler.transformer.impl.RenameOperation

RenameTransformer - Class in com.norconex.importer.handler.transformer.impl

Rename metadata fields to different names.

RenameTransformer() - Constructor for class com.norconex.importer.handler.transformer.impl.RenameTransformer

RenameTransformerConfig - Class in com.norconex.importer.handler.transformer.impl

Rename metadata fields to different names.

RenameTransformerConfig() - Constructor for class com.norconex.importer.handler.transformer.impl.RenameTransformerConfig

replace(String, T, T) - Method in interface com.norconex.crawler.core.cluster.CacheMap

replace(String, T, T) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastMapAdapter

replace(String, T, T) - Method in class com.norconex.crawler.core.cluster.impl.memory.InMemoryCacheMap

replace(String, T, T) - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheMap

REPLACE_IP_WITH_DOMAIN_NAME - Enum constant in enum class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizerConfig.Normalization

ReplaceOperation - Class in com.norconex.importer.handler.transformer.impl

ReplaceOperation() - Constructor for class com.norconex.importer.handler.transformer.impl.ReplaceOperation

ReplaceTransformer - Class in com.norconex.importer.handler.transformer.impl

Replaces every occurrences of the given replacements (document content only).

ReplaceTransformer() - Constructor for class com.norconex.importer.handler.transformer.impl.ReplaceTransformer

ReplaceTransformerConfig - Class in com.norconex.importer.handler.transformer.impl

Replaces every occurrences of the given replacements (document content only).

ReplaceTransformerConfig() - Constructor for class com.norconex.importer.handler.transformer.impl.ReplaceTransformerConfig

request(CommitterRequest) - Method in class com.norconex.committer.core.CommitterEvent.CommitterEventBuilder

requeueEntry(CrawlerEntry) - Method in class com.norconex.crawler.core.ledger.CrawlerEntryLedger

requeueEntry(String) - Method in class com.norconex.crawler.core.ledger.CrawlerEntryLedger

RequeueOrphansForDeletionStep - Class in com.norconex.crawler.core.cmd.crawl.pipeline.orphans

Queue orphans for deletion.

RequeueOrphansForDeletionStep(String) - Constructor for class com.norconex.crawler.core.cmd.crawl.pipeline.orphans.RequeueOrphansForDeletionStep

RequeueOrphansForProcessingStep - Class in com.norconex.crawler.core.cmd.crawl.pipeline.orphans

Queue orphans for processing.

RequeueOrphansForProcessingStep(String) - Constructor for class com.norconex.crawler.core.cmd.crawl.pipeline.orphans.RequeueOrphansForProcessingStep

requeueProcessingEntries() - Method in class com.norconex.crawler.core.ledger.CrawlerEntryLedger

Re-queues entries that were in PROCESSING state from a previous run.

requeueQueuedEntries() - Method in class com.norconex.crawler.core.ledger.CrawlerEntryLedger

Re-queues entries that were in QUEUED state from a previous run.

REQUIRED - Enum constant in enum class com.norconex.crawler.core.fetch.FetchDirectiveSupport

reset() - Method in interface com.norconex.crawler.core.cluster.Counter

resetPeakThreadCount() - Static method in class com.norconex.crawler.core.util.ThreadTracker

resize - Static variable in class com.norconex.importer.handler.parser.impl.OcrConfig.Fields

resolve(CrawlerSession) - Static method in class com.norconex.crawler.core.session.CrawlerRunInfoResolver

Resolve the current crawl run info

resolve(SitemapContext) - Method in class com.norconex.crawler.web.doc.operations.sitemap.impl.GenericSitemapResolver

resolve(SitemapContext) - Method in interface com.norconex.crawler.web.doc.operations.sitemap.SitemapResolver

resolve(Doc) - Static method in class com.norconex.importer.util.CommonAttributesResolver

resolve(Doc, boolean) - Static method in class com.norconex.importer.util.CommonAttributesResolver

resolve(String) - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyPath

resolve(String, WebCrawlerEntry) - Method in class com.norconex.crawler.web.doc.operations.scope.impl.GenericUrlScopeResolver

resolve(String, WebCrawlerEntry) - Method in interface com.norconex.crawler.web.doc.operations.scope.UrlScopeResolver

resolve(Path) - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyPath

resolve(HttpClient, WebCrawlerEntry) - Static method in class com.norconex.crawler.web.fetch.util.HstsResolver

resolveCharset(Charset) - Method in class com.norconex.importer.handler.DocHandlerContext

Return the most appropriate charset for the current context.

RESOLVED_SITES_CACHE_NAME - Static variable in interface com.norconex.crawler.web.doc.operations.scope.UrlScopeResolver

resolveDocumentChecksum(String, CrawlerDocContext) - Static method in class com.norconex.crawler.core.doc.pipelines.ChecksumStageUtil

resolveExplicitDelay(String) - Method in class com.norconex.crawler.web.doc.operations.delay.impl.AbstractDelayResolver

Resolves explicitly specified delay, in milliseconds.

resolveExplicitDelay(String) - Method in class com.norconex.crawler.web.doc.operations.delay.impl.GenericDelayResolver

resolveExplicitDelay(String) - Method in class com.norconex.crawler.web.doc.operations.delay.impl.ReferenceDelayResolver

resolveMetaChecksum(String, CrawlerDocContext) - Static method in class com.norconex.crawler.core.doc.pipelines.ChecksumStageUtil

resolvePath(String) - Method in class com.norconex.crawler.fs.fetch.impl.AbstractNioFetcher

Resolves a crawler reference (as found on Doc.getReference()) into a NIO.2 Path.

resolvePath(String) - Method in class com.norconex.crawler.fs.fetch.impl.adlsgen2.AdlsGen2Fetcher

resolvePath(String) - Method in class com.norconex.crawler.fs.fetch.impl.archive.ArchiveFetcher

resolvePath(String) - Method in class com.norconex.crawler.fs.fetch.impl.azureblob.AzureBlobFetcher

resolvePath(String) - Method in class com.norconex.crawler.fs.fetch.impl.cmis.CmisFetcher

resolvePath(String) - Method in class com.norconex.crawler.fs.fetch.impl.ftp.FtpFetcher

resolvePath(String) - Method in class com.norconex.crawler.fs.fetch.impl.gcs.GcsFetcher

resolvePath(String) - Method in class com.norconex.crawler.fs.fetch.impl.hdfs.HdfsFetcher

resolvePath(String) - Method in class com.norconex.crawler.fs.fetch.impl.local.LocalFetcher

resolvePath(String) - Method in class com.norconex.crawler.fs.fetch.impl.s3.S3Fetcher

resolvePath(String) - Method in class com.norconex.crawler.fs.fetch.impl.sftp.SftpFetcher

resolvePath(String) - Method in class com.norconex.crawler.fs.fetch.impl.smb.SmbFetcher

resolvePath(String) - Method in class com.norconex.crawler.fs.fetch.impl.webdav.WebDavFetcher

resolveSibling(String) - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyPath

resolveSibling(Path) - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyPath

resolveSpoiledReferenceStrategy(String, ProcessingOutcome) - Method in class com.norconex.crawler.core.doc.operations.spoil.impl.GenericSpoiledReferenceStrategizer

resolveSpoiledReferenceStrategy(String, ProcessingOutcome) - Method in interface com.norconex.crawler.core.doc.operations.spoil.SpoiledReferenceStrategizer

Establish which spoiled reference strategy to adopt.

resolveStoreInstance(HazelcastInstance, String, String, String) - Static method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastUtil

Resolves a HazelcastInstance for use by a store factory, with deterministic fallback behavior to handle EAGER store initialization timing while preventing accidental binding to stale clusters.

resolveTempDir(CrawlerConfig) - Static method in class com.norconex.crawler.core.util.ConfigUtil

resolveWorkDir(CrawlerConfig) - Static method in class com.norconex.crawler.core.util.ConfigUtil

RESOLVING - Enum constant in enum class com.norconex.crawler.web.doc.operations.scope.UrlScopeResolver.SitemapPresence

responseAggregator() - Method in class com.norconex.crawler.core.CrawlerDriver.FetchDriver

responseAggregator(MultiFetcher.ResponseAggregator) - Method in class com.norconex.crawler.core.CrawlerDriver.FetchDriver

responseAggregator(MultiFetcher.ResponseAggregator) - Method in class com.norconex.crawler.core.fetch.MultiFetcher.Builder

Restricting committer to specific documents - Search tag in class com.norconex.committer.core.AbstractCommitter

Section

Restricting committer to specific documents - Search tag in class com.norconex.committer.core.BaseCommitterConfig

Section

resumed(boolean) - Method in class com.norconex.crawler.core.cluster.pipeline.PipelineResult.PipelineResultBuilder

RESUMED - Enum constant in enum class com.norconex.crawler.core.session.CrawlerResumeState

The crawler resumed from a prior incomplete execution (e.g., paused or failed).

retryDelay(Duration) - Method in class com.norconex.crawler.core.fetch.MultiFetcher.Builder

RETURN_VALUE_VAR_NAME - Static variable in class com.norconex.importer.handler.ScriptRunner

RFC_4180 - Enum constant in enum class com.norconex.committer.core.fs.impl.CsvFileCommitterConfig.CsvFormat

Robot Directives - Search tag in class com.norconex.crawler.web.WebCrawlerConfig

Section

RobotsMeta - Class in com.norconex.crawler.web.doc.operations.robot

RobotsMeta(boolean, boolean) - Constructor for class com.norconex.crawler.web.doc.operations.robot.RobotsMeta

RobotsMetaCreateStage - Class in com.norconex.crawler.web.doc.pipelines.importer.stages

Robots meata creation.

RobotsMetaCreateStage() - Constructor for class com.norconex.crawler.web.doc.pipelines.importer.stages.RobotsMetaCreateStage

RobotsMetaNoIndexStage - Class in com.norconex.crawler.web.doc.pipelines.importer.stages

Robots Meta NoIndex Check.

RobotsMetaNoIndexStage() - Constructor for class com.norconex.crawler.web.doc.pipelines.importer.stages.RobotsMetaNoIndexStage

robotsMetaProvider - Static variable in class com.norconex.crawler.web.WebCrawlerConfig.Fields

RobotsMetaProvider - Interface in com.norconex.crawler.web.doc.operations.robot

Responsible for extracting robot information from a page.

robotsTxt(CrawlerContext, String) - Static method in class com.norconex.crawler.web.util.Web

RobotsTxt - Class in com.norconex.crawler.web.doc.operations.robot

Immutable holder of robots.txt rules.

RobotsTxt.RobotsTxtBuilder - Class in com.norconex.crawler.web.doc.operations.robot

RobotsTxtFilter - Interface in com.norconex.crawler.web.doc.operations.robot

Holds a robots.txt rule.

RobotsTxtFiltersStage - Class in com.norconex.crawler.web.doc.pipelines.queue.stages

Apply robot rules provided by resolved RobotsTxt.

RobotsTxtFiltersStage() - Constructor for class com.norconex.crawler.web.doc.pipelines.queue.stages.RobotsTxtFiltersStage

robotsTxtProvider - Static variable in class com.norconex.crawler.web.WebCrawlerConfig.Fields

RobotsTxtProvider - Interface in com.norconex.crawler.web.doc.operations.robot

Given a URL, extract any "robots.txt" rules.

robotsTxtSitemapDisabled - Static variable in class com.norconex.crawler.web.doc.operations.sitemap.impl.GenericSitemapLocatorConfig.Fields

run() - Method in class com.norconex.crawler.core.cli.CliBase

run() - Method in class com.norconex.crawler.core.cli.CliRunner

run() - Method in class com.norconex.crawler.core.cmd.stop.StopCommand

run(Connection) - Method in interface com.norconex.crawler.core.cluster.impl.hazelcast.jdbc.JdbcClient.SQLTask

runCommand(Crawler) - Method in class com.norconex.crawler.core.cli.CliBase

runCommand(Crawler) - Method in class com.norconex.crawler.core.cli.CliClean

runCommand(Crawler) - Method in class com.norconex.crawler.core.cli.CliConfigCheck

runCommand(Crawler) - Method in class com.norconex.crawler.core.cli.CliConfigRender

runCommand(Crawler) - Method in class com.norconex.crawler.core.cli.CliStart

runCommand(Crawler) - Method in class com.norconex.crawler.core.cli.CliStop

runCommand(Crawler) - Method in class com.norconex.crawler.core.cli.CliStoreExport

runCommand(Crawler) - Method in class com.norconex.crawler.core.cli.CliStoreImport

RUNNING - Enum constant in enum class com.norconex.crawler.core.cluster.pipeline.PipelineStatus

RUNNING - Enum constant in enum class com.norconex.crawler.core.session.CrawlerState

runWithAutoShutdown(Runnable, ExecutorService) - Static method in class com.norconex.crawler.core.util.ConcurrentUtil

runWithInterruptClear(Runnable) - Static method in class com.norconex.crawler.core.util.ExceptionSwallower

Runs the given runnable, clearing the thread's interrupt flag before execution and restoring it after if it was set.

runWithInterruptClearEx(FailableRunnable<Exception>) - Static method in class com.norconex.crawler.core.util.ExceptionSwallower

Runs the given FailableRunnable, clearing the thread's interrupt flag before execution and restoring it after if it was set.

S

S3Fetcher - Class in com.norconex.crawler.fs.fetch.impl.s3

Fetcher for Amazon S3 (s3://bucket/key), backed by a custom, read-only NIO.2 FileSystemProvider (S3FileSystemProvider) built directly on the standard AWS SDK v2 S3Client - not the AWS Common Runtime (CRT) client, avoiding its ~19MB native-library dependency.

S3Fetcher() - Constructor for class com.norconex.crawler.fs.fetch.impl.s3.S3Fetcher

S3FetcherConfig - Class in com.norconex.crawler.fs.fetch.impl.s3

Configuration for S3Fetcher.

S3FetcherConfig() - Constructor for class com.norconex.crawler.fs.fetch.impl.s3.S3FetcherConfig

SAFARI - Enum constant in enum class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverBrowser

safeCall(Function<WebDriver, T>) - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverManager

Wrap any WebDriver action so that on failure we reset and retry once.

sanitize(String) - Method in class com.norconex.crawler.core.util.StringSanitizer

SAT - Enum constant in enum class com.norconex.crawler.web.doc.operations.delay.impl.DelaySchedule.DOW

SaveDocumentTransformer - Class in com.norconex.importer.handler.transformer.impl

Saves a copy of the document at its current processing state in the specified directory.

SaveDocumentTransformer() - Constructor for class com.norconex.importer.handler.transformer.impl.SaveDocumentTransformer

SaveDocumentTransformerConfig - Class in com.norconex.importer.handler.transformer.impl

Saves a copy of the document at its current processing state in the specified directory.

SaveDocumentTransformerConfig() - Constructor for class com.norconex.importer.handler.transformer.impl.SaveDocumentTransformerConfig

Scale() - Constructor for class com.norconex.importer.handler.transformer.impl.ImageTransformerConfig.Scale

ScopedThreadFactoryCreator - Class in com.norconex.crawler.core.util

Creates ThreadFactory instances with a thread name prefixed with a scope name and can log extra information on threads at job run begin/stop (if DEBUG is enabled).

ScopedThreadFactoryCreator(String) - Constructor for class com.norconex.crawler.core.util.ScopedThreadFactoryCreator

ScreenshotHandlerConfig - Class in com.norconex.crawler.web.fetch.util

Configuration for screenshot handlers (Selenium WebDriver and Playwright).

ScreenshotHandlerConfig() - Constructor for class com.norconex.crawler.web.fetch.util.ScreenshotHandlerConfig

ScriptCondition - Class in com.norconex.importer.handler.condition.impl

A condition formulated using a scripting language.

ScriptCondition() - Constructor for class com.norconex.importer.handler.condition.impl.ScriptCondition

ScriptConditionConfig - Class in com.norconex.importer.handler.condition.impl

A condition formulated using a scripting language.

ScriptConditionConfig() - Constructor for class com.norconex.importer.handler.condition.impl.ScriptConditionConfig

ScriptRunner<T> - Class in com.norconex.importer.handler

Runs scripts written in supported programming languages.

ScriptRunner(String, String) - Constructor for class com.norconex.importer.handler.ScriptRunner

ScriptTransformer - Class in com.norconex.importer.handler.transformer.impl

Transform incoming documents using a scripting language.

ScriptTransformer() - Constructor for class com.norconex.importer.handler.transformer.impl.ScriptTransformer

ScriptTransformerConfig - Class in com.norconex.importer.handler.transformer.impl

Transform incoming documents using a scripting language.

ScriptTransformerConfig() - Constructor for class com.norconex.importer.handler.transformer.impl.ScriptTransformerConfig

SEARCH_QUALITY_METADATA - Enum constant in enum class com.norconex.committer.googlecloudsearch.MetadataField

SECOND - Enum constant in enum class com.norconex.importer.handler.condition.impl.DateCondition.TimeUnit

SECURE_SCHEME - Enum constant in enum class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizerConfig.Normalization

SegmentCountUrlFilter - Class in com.norconex.crawler.web.doc.operations.filter.impl

Filters URL based based on the number of URL segments.

SegmentCountUrlFilter() - Constructor for class com.norconex.crawler.web.doc.operations.filter.impl.SegmentCountUrlFilter

SegmentCountUrlFilterConfig - Class in com.norconex.crawler.web.doc.operations.filter.impl

Configuration for SegmentCountUrlFilter.

SegmentCountUrlFilterConfig() - Constructor for class com.norconex.crawler.web.doc.operations.filter.impl.SegmentCountUrlFilterConfig

segments() - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyPath

self() - Method in class com.norconex.committer.core.CommitterEvent.CommitterEventBuilder

self() - Method in class com.norconex.committer.core.service.CommitterServiceEvent.CommitterServiceEventBuilder

self() - Method in class com.norconex.crawler.core.event.CrawlerEvent.CrawlerEventBuilder

self() - Method in class com.norconex.importer.ImporterEvent.ImporterEventBuilder

SELF_ONLY - Enum constant in enum class com.norconex.crawler.fs.fetch.impl.m365graph.M365GraphFetcherConfig.SourceDeltaExpansion

Keep the start reference itself as the source-delta root.

SentimentConfig - Class in com.norconex.importer.handler.parser.impl

Tika sentiment analysis configuration (via Tika's SentimentAnalysisParser).

SentimentConfig() - Constructor for class com.norconex.importer.handler.parser.impl.SentimentConfig

serialize(Condition, JsonGenerator, SerializationContext) - Method in class com.norconex.importer.handler.condition.ConditionSerializer

serialize(List<DocHandler>, JsonGenerator, SerializationContext) - Method in class com.norconex.importer.handler.DocHandlerListSerializer

SerializedCache - Class in com.norconex.crawler.core.cluster

SerializedCache() - Constructor for class com.norconex.crawler.core.cluster.SerializedCache

SerializedCache.CacheType - Enum Class in com.norconex.crawler.core.cluster

SerializedCache.SerializedEntry - Class in com.norconex.crawler.core.cluster

SerializedEntry() - Constructor for class com.norconex.crawler.core.cluster.SerializedCache.SerializedEntry

SerializedEntry(String, String) - Constructor for class com.norconex.crawler.core.cluster.SerializedCache.SerializedEntry

SerializedRecord - Class in com.norconex.crawler.core.cluster

Backend-agnostic envelope for storing arbitrary objects as a pair of: - className: fully qualified class name of the original object - serialized: JSON representation of the original object This type intentionally has no backend-specific annotations so it can be used in any storage path (e.g., String caches, DB) and adapted by backend-specific wrappers (e.g., Protostream-annotated classes).

SerializedRecord() - Constructor for class com.norconex.crawler.core.cluster.SerializedRecord

SerializedRecord(Object) - Constructor for class com.norconex.crawler.core.cluster.SerializedRecord

serializeWithType(Condition, JsonGenerator, SerializationContext, TypeSerializer) - Method in class com.norconex.importer.handler.condition.ConditionSerializer

SerialUtil - Class in com.norconex.crawler.core.util

session(CrawlerSession) - Method in class com.norconex.crawler.core.cmd.crawl.pipeline.process.BatchDispatcher.BatchDispatcherBuilder

set(long) - Method in interface com.norconex.crawler.core.cluster.Counter

setAccessKey(String) - Method in class com.norconex.committer.amazoncloudsearch.AmazonCloudSearchCommitterConfig

The CloudSearch access key.

setAccessToken(String) - Method in class com.norconex.crawler.fs.fetch.impl.box.BoxFetcherConfig

OAuth access token used for Box API requests.

setAccessToken(String) - Method in class com.norconex.crawler.fs.fetch.impl.egnyte.EgnyteFetcherConfig

OAuth access token used for Egnyte API requests.

setAclDisabled(boolean) - Method in class com.norconex.crawler.fs.fetch.impl.adlsgen2.AdlsGen2FetcherConfig

Whether ACL, owner, and group metadata extraction is disabled.

setAclDisabled(boolean) - Method in class com.norconex.crawler.fs.fetch.impl.cmis.CmisFetcherConfig

setAclDisabled(boolean) - Method in class com.norconex.crawler.fs.fetch.impl.local.LocalFetcherConfig

setAclDisabled(boolean) - Method in class com.norconex.crawler.fs.fetch.impl.smb.SmbFetcherConfig

setAclInheritance(GoogleCloudSearchCommitterConfig.AclInheritanceMapping) - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig

ACL inheritance configuration, mapping a metadata field holding a parent item reference to an ACL inheritance type.

setAclInheritanceType(GoogleCloudSearchCommitterConfig.AclInheritanceType) - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.AclInheritanceMapping

ACL inheritance type.

setAclMappings(List<GoogleCloudSearchCommitterConfig.AclMapping>) - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig

setAction(String) - Method in class com.norconex.importer.handler.transformer.impl.ForceSingleValueTransformerConfig

The action.

setAddCount(long) - Method in class com.norconex.committer.core.impl.LogCommitter

setAdminDisabled(boolean) - Method in class com.norconex.crawler.core.cluster.ClusterConfig

Disable launching the crawler administrative server endpoints.

setAdminPort(int) - Method in class com.norconex.crawler.core.cluster.ClusterConfig

Port the crawler cluster listens to for administrative commands, on each nodes.

setApi(String) - Method in class com.norconex.importer.handler.splitter.impl.TranslatorSplitterConfig

Supported translation service API name.

setApiBaseUrl(String) - Method in class com.norconex.crawler.fs.fetch.impl.box.BoxFetcherConfig

Box API base URL.

setApiBaseUrl(String) - Method in class com.norconex.crawler.fs.fetch.impl.egnyte.EgnyteFetcherConfig

Egnyte API base URL.

setApiEndpoint(String) - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig

Overrides the Google Cloud Search API root URL.

setApiKey(String) - Method in class com.norconex.committer.azurecognitivesearch.AzureSearchCommitterConfig

The Azure API admin key.

setApiKey(String) - Method in class com.norconex.committer.elasticsearch.ElasticsearchCommitterConfig

The Base64-encoded API key for Elasticsearch API Key authentication.

setApiKey(String) - Method in class com.norconex.importer.handler.splitter.impl.TranslatorSplitterConfig

Google or Yandex API key.

setApiVersion(String) - Method in class com.norconex.committer.azurecognitivesearch.AzureSearchCommitterConfig

The Azure API version.

setAppendHash(boolean) - Method in class com.norconex.importer.handler.transformer.impl.TruncateTransformerConfig

Whether to apply the original string hash code at the end of the truncation to help ensure uniqueness (no guarantee).

setApplicationName(String) - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig

The application name sent to Google Cloud Search.

setApplicationName(String) - Method in class com.norconex.crawler.fs.fetch.impl.googledrive.GoogleDriveFetcherConfig

Optional Google API application name.

setApplyRotation(Boolean) - Method in class com.norconex.importer.handler.parser.impl.OcrConfig

setApplyTo(GenericRecrawlableResolverConfig.MinFrequency.ApplyTo) - Method in class com.norconex.crawler.web.doc.operations.recrawl.impl.GenericRecrawlableResolverConfig.MinFrequency

Whether to apply this minimum frequency to matching content type or document reference.

setApplyTo(String) - Method in class com.norconex.importer.handler.transformer.impl.CharacterCaseTransformerConfig

Whether to apply the case transformation to fields, values, or both.

setArgs(List<String>) - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcherConfig

Sets the browser launch arguments.

setArrayFields(String) - Method in class com.norconex.committer.azurecognitivesearch.AzureSearchCommitterConfig

The fields which values should always be treated as array.

setArrayFieldsRegex(boolean) - Method in class com.norconex.committer.azurecognitivesearch.AzureSearchCommitterConfig

Whether the list of fields to be always treated as array is represented as regular expression.

setAttribute(Path, String, Object, LinkOption...) - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyFileSystemProvider

setAuthentication(HttpAuthConfig) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

Authentication configuration for sites requiring it.

setAuthMethod(HdfsAuthMethod) - Method in class com.norconex.crawler.fs.fetch.impl.hdfs.HdfsFetcherConfig

Authentication method.

setAuthorityHost(String) - Method in class com.norconex.crawler.fs.fetch.impl.m365graph.M365GraphFetcherConfig

Authentication authority host.

setAutoCommitBufferSize(int) - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreClusterConnectorConfig

The auto-commit buffer size in KB.

setAutoCommitDelay(int) - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreClusterConnectorConfig

The auto-commit delay in milliseconds.

setAutoCompactFillRate(int) - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreClusterConnectorConfig

The auto-compact fill rate (0-100).

setAutodetectUtf8(boolean) - Method in class com.norconex.crawler.fs.fetch.impl.ftp.FtpFetcherConfig

setAutoDiscoveryEnabled(boolean) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.JdbcHazelcastConfigurer

Whether to use Hazelcast auto-discovery in clustered mode.

setBackupCount(int) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.JdbcHazelcastConfigurer

Hazelcast backup count.

setBatchSize(int) - Method in class com.norconex.committer.core.batch.queue.impl.FsQueueConfig

The number of documents to be queued in a batch on disk before consuming that batch.

setBegin(long) - Method in class com.norconex.importer.handler.transformer.impl.SubstringTransformerConfig

The beginning index (inclusive).

setBoolean(String, boolean) - Method in class com.norconex.crawler.core.session.CrawlerAttributes

Sets an attribute as a boolean.

setBooleanIfAbsent(String, boolean) - Method in class com.norconex.crawler.core.session.CrawlerAttributes

Atomically sets an attribute as a boolean if it is not already set.

setBootstrapServers(String) - Method in class com.norconex.committer.apachekafka.ApacheKafkaCommitterConfig

The Apache Kafka broker list, comma-separated (e.g., host1:port1,host2:port2,...).

setBrowser(PlaywrightBrowser) - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcherConfig

The browser engine used for crawling.

setBrowser(WebDriverBrowser) - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig

The browser used for crawling.

setBrowserMaxAge(Duration) - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcherConfig

Maximum age of a per-thread browser instance before it is restarted.

setBrowserMaxAge(Duration) - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig

A maximum duration at which we restart the browser.

setBrowserMaxNavigations(int) - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcherConfig

A maximum number of navigations after which each per-thread browser instance is restarted.

setBrowserMaxNavigations(int) - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig

A maximum number of navigations at which we restart the browser.

setBrowserPath(Path) - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig

Local path to browser executable or null to attempt automatic browser path detection.

setCacheName(String) - Method in class com.norconex.crawler.core.cluster.SerializedCache

setCacheSize(int) - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreClusterConnectorConfig

The cache size in MB.

setCacheType(SerializedCache.CacheType) - Method in class com.norconex.crawler.core.cluster.SerializedCache

setCanonicalLinkDetector(CanonicalLinkDetector) - Method in class com.norconex.crawler.web.WebCrawlerConfig

The canonical link detector.

setCapabilities(Map<String, String>) - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig

Sets optional capabilities (configuration options) for the web driver.

setCaseType(String) - Method in class com.norconex.importer.handler.transformer.impl.CharacterCaseTransformerConfig

The type of character case transformation.

setCfs(boolean) - Method in class com.norconex.committer.idol.IdolCommitterConfig

Whether the IDOL index URL points to a Connector Framework Server (CFS).

setChainedProxy(ProxySettings) - Method in class com.norconex.crawler.web.fetch.impl.webdriver.HttpSnifferConfig

Sets chained proxy settings, if any.

setChangeDiscovery(CrawlerConfig.ChangeDiscovery) - Method in class com.norconex.crawler.core.CrawlerConfig

Change discovery strategy.

setChannel(String) - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcherConfig

Optional browser channel that instructs Playwright to use a system-installed browser instead of its own downloaded binaries.

setCharset(Charset) - Method in class com.norconex.crawler.core.ledger.CrawlerEntry

setCharset(Charset) - Method in class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractorConfig

The assumed source character encoding.

setCharset(Charset) - Method in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractorConfig

The character set to use for pages on which link extraction is performed.

setCharset(Charset) - Method in class com.norconex.crawler.web.doc.operations.link.impl.RegexLinkExtractorConfig

Gets the character set of pages on which link extraction is performed.

setCharset(Charset) - Method in class com.norconex.importer.doc.Doc

setCharset(Charset) - Method in class com.norconex.importer.ImporterRequest

setChildPaths(Set<FsPath>) - Method in class com.norconex.crawler.fs.fetch.impl.GenericFolderPathsFetchResponse

setClassName(String) - Method in class com.norconex.crawler.core.cluster.SerializedCache

setClassName(String) - Method in class com.norconex.crawler.core.cluster.SerializedRecord

setCleanupInterval(Duration) - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcherConfig

Interval between checks for idle (unused) browser instances to close.

setCleanupInterval(Duration) - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig

Amount of time between each check for unused browser instances and closing them.

setClientEmail(String) - Method in class com.norconex.crawler.fs.fetch.impl.googledrive.GoogleDriveFetcherConfig

Service account client email.

setClientId(String) - Method in class com.norconex.crawler.fs.fetch.impl.m365graph.M365GraphFetcherConfig

Azure AD application (client) ID.

setClientId(String) - Method in class com.norconex.importer.handler.splitter.impl.TranslatorSplitterConfig

Microsoft API client id.

setClientSecret(String) - Method in class com.norconex.crawler.fs.fetch.impl.m365graph.M365GraphFetcherConfig

Azure AD client secret.

setClientSecret(String) - Method in class com.norconex.importer.handler.splitter.impl.TranslatorSplitterConfig

Microsoft API client secret.

setClosed(boolean) - Method in class com.norconex.committer.core.impl.MemoryCommitter

setClusterConfig(ClusterConfig) - Method in class com.norconex.crawler.core.CrawlerConfig

The Importer module configuration.

setClustered(boolean) - Method in class com.norconex.crawler.core.cluster.ClusterConfig

Whether the crawler should run in stand-alone or cluster mode.

setClusterName(String) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastClusterConnectorConfig

Cluster name for Hazelcast instance.

setColorSpace(String) - Method in class com.norconex.importer.handler.parser.impl.OcrConfig

setColumnKeyType(String) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.JdbcHazelcastConfigurer

SQL column type for map/queue keys.

setColumns(List<CsvColumn>) - Method in class com.norconex.committer.core.fs.impl.CsvFileCommitterConfig

setColumnValueType(String) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.JdbcHazelcastConfigurer

SQL column type for map values.

setCombineFieldsAndContent(boolean) - Method in class com.norconex.crawler.core.doc.operations.checksum.impl.Md5DocumentChecksummerConfig

Whether we are combining the fields and content checksums.

setCommand(String) - Method in class com.norconex.importer.handler.transformer.impl.ExternalTransformerConfig

The command to execute.

setCommentsEnabled(boolean) - Method in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractorConfig

Gets whether links should be extracted from comments.

setCommitLeftoversOnInit(boolean) - Method in class com.norconex.committer.core.batch.queue.impl.FsQueueConfig

During initialization, whether to attempt committing any leftover files in the committer queue from a previous crawl session.

setCommitters(List<Committer>) - Method in class com.norconex.crawler.core.CrawlerConfig

Sets Committers responsible for persisting information to a target location/repository.

setCompress(boolean) - Method in class com.norconex.committer.core.fs.BaseFsCommitterConfig

setCompress(int) - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreClusterConnectorConfig

The compression level (0=off, 1=fast/LZF, 2=high/Deflate).

setCompression(String) - Method in class com.norconex.crawler.fs.fetch.impl.sftp.SftpFetcherConfig

setCondition(Condition) - Method in class com.norconex.importer.handler.condition.ConditionalDocHandler

setConditionZoneId(ZoneId) - Method in class com.norconex.importer.handler.condition.impl.DateConditionConfig

setConfigFile(Path) - Method in class com.norconex.crawler.core.cli.CliBase

setConfiguration(DocImageHandlerConfig) - Method in class com.norconex.crawler.web.fetch.util.DocImageHandler

setConfigurer(HazelcastConfigurer) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastClusterConnectorConfig

The configurer responsible for building the Hazelcast Config.

setConnectionRequestTimeout(Duration) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

Gets the timeout when requesting a connection.

setConnectionTimeout(Duration) - Method in class com.norconex.committer.elasticsearch.ElasticsearchCommitterConfig

Elasticsearch connection timeout.

setConnectionTimeout(Duration) - Method in class com.norconex.crawler.fs.fetch.impl.webdav.WebDavFetcherConfig

setConnectionTimeout(Duration) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

The connection timeout for a connection to be established.

setConnectionUrl(String) - Method in class com.norconex.committer.sql.SqlCommitterConfig

JDBC connection URL.

setConnector(ClusterConnector) - Method in class com.norconex.crawler.core.cluster.ClusterConfig

The connector to the cluster implementation used to run the crawler.

setConnectorName(String) - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig

The connector name sent with indexing requests.

setConnectTimeout(Duration) - Method in class com.norconex.crawler.fs.fetch.impl.ftp.FtpFetcherConfig

setConnectTimeout(Duration) - Method in class com.norconex.crawler.fs.fetch.impl.sftp.SftpFetcherConfig

setConstants(List<Constant>) - Method in class com.norconex.importer.handler.transformer.impl.ConstantTransformerConfig

Set constants to be added as metadata fields.

setContentChecksum(String) - Method in class com.norconex.crawler.core.ledger.CrawlerEntry

Sets the content checksum.

setContentColumns(List<String>) - Method in class com.norconex.importer.handler.splitter.impl.CsvSplitterConfig

One or several columns containing the text to be considered as the document "content".

setContentType(ContentType) - Method in class com.norconex.crawler.core.ledger.CrawlerEntry

setContentType(ContentType) - Method in class com.norconex.importer.doc.Doc

setContentType(ContentType) - Method in class com.norconex.importer.ImporterRequest

setContentTypeMatcher(TextMatcher) - Method in class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractorConfig

The matcher of content types to apply link extraction on.

setContentTypeMatcher(TextMatcher) - Method in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractorConfig

The matcher of content types to apply link extraction on.

setContentTypeMatcher(TextMatcher) - Method in class com.norconex.crawler.web.doc.operations.link.impl.RegexLinkExtractorConfig

The matcher of content types to apply link extraction on.

setContentTypeMatcher(TextMatcher) - Method in class com.norconex.crawler.web.doc.operations.link.impl.TikaLinkExtractorConfig

The matcher of content types to apply link extraction on.

setContentTypeMatcher(TextMatcher) - Method in class com.norconex.crawler.web.doc.operations.link.impl.XmlFeedLinkExtractorConfig

The matcher of content types to apply link extraction on.

setContentTypeMatcher(TextMatcher) - Method in class com.norconex.importer.handler.condition.impl.DomConditionConfig

Sets this condition content-type matcher.

setContentTypeMatcher(TextMatcher) - Method in class com.norconex.importer.handler.parser.impl.OcrConfig

The matcher of content types to apply OCR on.

setContentTypeMatcher(TextMatcher) - Method in class com.norconex.importer.handler.splitter.impl.DomSplitterConfig

The matcher of content types to apply splitting on.

setContentTypeMatcher(TextMatcher) - Method in class com.norconex.importer.handler.splitter.impl.PdfPageSplitterConfig

The matcher of content types to apply splitting on.

setContentTypeMatcher(TextMatcher) - Method in class com.norconex.importer.handler.splitter.impl.XmlStreamSplitterConfig

The matcher of content types to apply splitting on.

setContentTypeMatcher(TextMatcher) - Method in class com.norconex.importer.handler.transformer.impl.DomTransformerConfig

The matcher of content types to apply transformation on.

setContentTypeMatcher(TextMatcher) - Method in class com.norconex.importer.handler.transformer.impl.ImageTransformerConfig

The matcher of content types to apply transformation on.

setContentTypes(List<ContentType>) - Method in class com.norconex.crawler.web.doc.operations.canon.impl.GenericCanonicalLinkDetectorConfig

Sets the content types on which to perform canonical link detection.

setControlEncoding(String) - Method in class com.norconex.crawler.fs.fetch.impl.ftp.FtpFetcherConfig

setControlKeepAliveReplyTimeout(Duration) - Method in class com.norconex.crawler.fs.fetch.impl.ftp.FtpFetcherConfig

setControlKeepAliveTimeout(Duration) - Method in class com.norconex.crawler.fs.fetch.impl.ftp.FtpFetcherConfig

setCookieSpec(HttpClientFetcherConfig.CookieSpec) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

Cookie specification to use when fetching documents.

setCount(int) - Method in class com.norconex.crawler.web.doc.operations.filter.impl.SegmentCountUrlFilterConfig

Number of segments after which this filter is considered a match.

setCountMatcher(TextMatcher) - Method in class com.norconex.importer.handler.transformer.impl.CountMatchesTransformerConfig

Sets the count matcher.

setCrawlDate(ZonedDateTime) - Method in class com.norconex.crawler.web.doc.operations.sitemap.SitemapRecord

setCrawlDocContext(CrawlerDocContext) - Method in class com.norconex.crawler.web.fetch.WebFetchRequest

The crawl doc context, providing access to the current and previous crawl entries (e.g. for ETag and If-Modified-Since support).

setCrawlState(CrawlerState) - Method in class com.norconex.crawler.core.session.CrawlerSession.State

setCreateFieldSQL(String) - Method in class com.norconex.committer.sql.SqlCommitterConfig

The ALTER statement used to create missing table fields.

setCreateTableSQL(String) - Method in class com.norconex.committer.sql.SqlCommitterConfig

The CREATE statement used to create a table if it does not already exist.

setCreateTopic(boolean) - Method in class com.norconex.committer.apachekafka.ApacheKafkaCommitterConfig

Whether to create the topic in Apache Kafka.

setCredentials(Credentials) - Method in class com.norconex.committer.elasticsearch.ElasticsearchCommitterConfig

Sets Elasticsearch authentication credentials.

setCredentials(Credentials) - Method in class com.norconex.committer.neo4j.Neo4jCommitterConfig

setCredentials(Credentials) - Method in class com.norconex.committer.solr.SolrCommitterConfig

Sets Solr authentication credentials.

setCredentials(Credentials) - Method in class com.norconex.committer.sql.SqlCommitterConfig

setCredentials(Credentials) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthConfig

setCssSelector(String) - Method in class com.norconex.crawler.web.fetch.util.ScreenshotHandlerConfig

setDatabase(String) - Method in class com.norconex.committer.neo4j.Neo4jCommitterConfig

A database name when using one other than the default one.

setDatabaseName(String) - Method in class com.norconex.committer.idol.IdolCommitterConfig

The IDOL database name.

setDataChannelProtectionLevel(DataChannelProtectionLevel) - Method in class com.norconex.crawler.fs.fetch.impl.ftp.FtpFetcherConfig

setDataSourceId(String) - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig

The Google Cloud Search data source ID to index documents into.

setDataTimeout(Duration) - Method in class com.norconex.crawler.fs.fetch.impl.ftp.FtpFetcherConfig

setDayOfMonthRange(DelayRange<Integer>) - Method in class com.norconex.crawler.web.doc.operations.delay.impl.DelaySchedule

setDayOfWeekRange(DelayRange<DelaySchedule.DOW>) - Method in class com.norconex.crawler.web.doc.operations.delay.impl.DelaySchedule

setDefaultDateFormat(String) - Method in class com.norconex.crawler.fs.fetch.impl.ftp.FtpFetcherConfig

setDefaultDelay(Duration) - Method in class com.norconex.crawler.web.doc.operations.delay.impl.BaseDelayResolverConfig

The default delay.

setDefaultFileName(String) - Method in class com.norconex.importer.handler.transformer.impl.SaveDocumentTransformerConfig

setDefaultValue(String) - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.MetadataMapping

Optional fallback value when GoogleCloudSearchCommitterConfig.MetadataMapping.fromField is missing or blank.

setDefaultValue(String) - Method in class com.norconex.importer.handler.transformer.impl.DomOperation

The value to store in the target field if there are no matches.

setDeferredShutdownDuration(Duration) - Method in class com.norconex.crawler.core.CrawlerConfig

The amount of time to defer the crawler shutdown when it is done executing.

setDelay(Duration) - Method in class com.norconex.crawler.web.doc.operations.delay.impl.DelaySchedule

setDelayReferencePatterns(List<DelayReferencePattern>) - Method in class com.norconex.crawler.web.doc.operations.delay.impl.ReferenceDelayResolverConfig

setDelayResolver(DelayResolver) - Method in class com.norconex.crawler.web.WebCrawlerConfig

The delay resolver dictating the minimum amount of time to wait between web requests.

setDelegatedUser(String) - Method in class com.norconex.crawler.fs.fetch.impl.googledrive.GoogleDriveFetcherConfig

Optional delegated Google Workspace user email for domain-wide delegation.

setDelete(boolean) - Method in class com.norconex.crawler.core.doc.pipelines.importer.ImporterPipelineContext

setDelete(boolean) - Method in class com.norconex.importer.handler.transformer.impl.DomOperation

The gets whether to delete DOM attributes/elements matching the specified selector.

setDeleteCypher(String) - Method in class com.norconex.committer.neo4j.Neo4jCommitterConfig

Cypher query for adding relationships to Neo4j.

setDeleted(boolean) - Method in class com.norconex.crawler.core.ledger.CrawlerEntry

setDeleteFromFields(boolean) - Method in class com.norconex.importer.handler.transformer.impl.MergeOperation

setDelimiter(Character) - Method in class com.norconex.committer.core.fs.impl.CsvFileCommitterConfig

Delimiter character to use.

setDensity(Integer) - Method in class com.norconex.importer.handler.parser.impl.OcrConfig

setDepth(int) - Method in class com.norconex.crawler.core.ledger.CrawlerEntry

Typically, the number of "hops" or directories to get to a file.

setDepth(Integer) - Method in class com.norconex.importer.handler.parser.impl.OcrConfig

setDescription(String) - Method in class com.norconex.importer.response.ImporterResponse

setDetectHeading(boolean) - Method in class com.norconex.importer.handler.transformer.impl.TitleGeneratorTransformerConfig

setDetectHeadingMaxLength(int) - Method in class com.norconex.importer.handler.transformer.impl.TitleGeneratorTransformerConfig

setDetectHeadingMinLength(int) - Method in class com.norconex.importer.handler.transformer.impl.TitleGeneratorTransformerConfig

setDirectory(Path) - Method in class com.norconex.committer.core.fs.BaseFsCommitterConfig

The directory where files are committed.

setDirSplitPattern(String) - Method in class com.norconex.importer.handler.transformer.impl.SaveDocumentTransformerConfig

setDisabled(boolean) - Method in class com.norconex.importer.handler.parser.impl.OcrConfig

setDisableDocKeyEncoding(boolean) - Method in class com.norconex.committer.azurecognitivesearch.AzureSearchCommitterConfig

Whether to disable document reference encoding.

setDiscardOriginal(boolean) - Method in class com.norconex.importer.handler.splitter.BaseDocumentSplitterConfig

Whether to discard the original document after it was split.

setDiscardUnchanged(boolean) - Method in class com.norconex.importer.handler.transformer.impl.ReplaceOperation

setDiscoverNodes(boolean) - Method in class com.norconex.committer.elasticsearch.ElasticsearchCommitterConfig

Whether automatic discovery of Elasticsearch cluster nodes should be enabled.

setDistributed(boolean) - Method in class com.norconex.crawler.core.cluster.pipeline.BaseStep

setDoc(Doc) - Method in class com.norconex.crawler.core.doc.CrawlerDocContext

setDoc(Doc) - Method in class com.norconex.importer.response.ImporterResponse

setDocsPerFile(int) - Method in class com.norconex.committer.core.fs.BaseFsCommitterConfig

setDocumentChecksummer(DocumentChecksummer) - Method in class com.norconex.crawler.core.CrawlerConfig

The document checksummer.

setDocumentDeduplicate(boolean) - Method in class com.norconex.crawler.core.CrawlerConfig

Whether to turn ON deduplication based on document checksum.

setDocumentFetchSupport(FetchDirectiveSupport) - Method in class com.norconex.crawler.core.CrawlerConfig

setDocumentFilters(List<DocumentFilter>) - Method in class com.norconex.crawler.core.CrawlerConfig

Sets document filters.

setDocZoneId(ZoneId) - Method in class com.norconex.importer.handler.condition.impl.DateConditionConfig

Time zone id to use for dates associated with a document when evaluating date conditions.

setDomain(String) - Method in class com.norconex.crawler.fs.fetch.impl.BaseAuthNioFetcherConfig

setDomain(String) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthConfig

Gets the NTLM authentication domain.

setDomSelector(String) - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig

Optional CSS-like path matching one or more image elements.

setDotReplacement(String) - Method in class com.norconex.committer.elasticsearch.ElasticsearchCommitterConfig

The character used to replace dots in field names.

setDriverClass(String) - Method in class com.norconex.committer.sql.SqlCommitterConfig

Class name of the JDBC driver to use.

setDriverPath(String) - Method in class com.norconex.committer.sql.SqlCommitterConfig

Path to JDBC driver.

setDriverPath(Path) - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig

Local path to driver executable or null to attempt automatic detection of the driver path.

setDuplicate(boolean) - Method in class com.norconex.crawler.web.doc.operations.filter.impl.SegmentCountUrlFilterConfig

Whether the configured segment count represents the number of duplicated segments for this filter to be considered a match.

setEarlyPageScript(String) - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcherConfig

Optional JavaScript code executed immediately after page navigation, before any wait conditions are applied.

setEarlyPageScript(String) - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig

Optional JavaScript code to be run the moment a page is requested.

setElseHandlers(List<DocHandler>) - Method in class com.norconex.importer.handler.condition.ConditionalDocHandler

setEnabled(boolean) - Method in class com.norconex.importer.handler.parser.impl.GrobidConfig

setEnabled(boolean) - Method in class com.norconex.importer.handler.parser.impl.SentimentConfig

setEnableImagePreprocessing(Boolean) - Method in class com.norconex.importer.handler.parser.impl.OcrConfig

setEnd(long) - Method in class com.norconex.importer.handler.transformer.impl.SubstringTransformerConfig

The end index (exclusive).

setEnd(T) - Method in class com.norconex.crawler.web.doc.operations.delay.impl.DelayRange

setEndMatcher(TextMatcher) - Method in class com.norconex.importer.handler.transformer.impl.StripBetweenOperation

Sets the end delimiter matcher for text to strip.

setEndMatcher(TextMatcher) - Method in class com.norconex.importer.handler.transformer.impl.TextBetweenOperation

Sets the end delimiter matcher for text to extract.

setEndpoint(String) - Method in class com.norconex.committer.azurecognitivesearch.AzureSearchCommitterConfig

Gets the Azure Search endpoint.

setEndpoint(String) - Method in class com.norconex.crawler.fs.fetch.impl.adlsgen2.AdlsGen2FetcherConfig

Optional service endpoint override.

setEndpoint(String) - Method in class com.norconex.crawler.fs.fetch.impl.azureblob.AzureBlobFetcherConfig

Optional service endpoint override.

setEndpoint(String) - Method in class com.norconex.crawler.fs.fetch.impl.gcs.GcsFetcherConfig

Optional endpoint override, mainly intended for GCS-compatible test servers such as fake-gcs-server.

setEndpoint(String) - Method in class com.norconex.crawler.fs.fetch.impl.s3.S3FetcherConfig

Custom endpoint URL, for S3-compatible services (e.g.

setEndpointURL(String) - Method in class com.norconex.crawler.fs.fetch.impl.cmis.CmisAtomSession

setEngineName(String) - Method in class com.norconex.importer.handler.condition.impl.ScriptConditionConfig

setEngineName(String) - Method in class com.norconex.importer.handler.transformer.impl.ScriptTransformerConfig

setEntries(Iterator<SerializedCache.SerializedEntry>) - Method in class com.norconex.crawler.core.cluster.SerializedCache

setEnvironmentVariables(Map<String, String>) - Method in class com.norconex.importer.handler.transformer.impl.ExternalTransformerConfig

Sets the environment variables.

setErrorsSaveDir(Path) - Method in class com.norconex.importer.handler.parser.impl.DefaultParserConfig

setEscape(boolean) - Method in class com.norconex.importer.handler.transformer.impl.SaveDocumentTransformerConfig

setEscape(Character) - Method in class com.norconex.committer.core.fs.impl.CsvFileCommitterConfig

Escape character.

setEscapeCharacter(char) - Method in class com.norconex.importer.handler.splitter.impl.CsvSplitterConfig

The escape character.

setEtag(String) - Method in class com.norconex.crawler.web.ledger.WebCrawlerEntry

The HTTP ETag.

setETagDisabled(boolean) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

Whether adding "ETag" If-None-Match HTTP request header is disabled.

setEventListeners(List<EventListener<?>>) - Method in class com.norconex.crawler.core.CrawlerConfig

Sets event listeners.

setEventManager(EventManager) - Method in class com.norconex.committer.core.CommitterContext.Builder

setEventMatcher(TextMatcher) - Method in class com.norconex.crawler.core.event.listeners.DeleteRejectedEventListenerConfig

Sets the event matcher used to identify which events can trigger a deletion request.

setEventMatcher(TextMatcher) - Method in class com.norconex.crawler.core.event.listeners.StopCrawlerOnMaxEventListenerConfig

Sets the event matcher used to identify which events will be counted.

setException(ImporterException) - Method in class com.norconex.importer.response.ImporterResponse

setException(Exception) - Method in class com.norconex.crawler.fs.fetch.impl.GenericFileFetchResponse

setException(Exception) - Method in class com.norconex.crawler.fs.fetch.impl.GenericFolderPathsFetchResponse

setException(Exception) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetchResponse

setExecutablePath(Path) - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcherConfig

Optional path to a custom browser executable.

setExpectContinueEnabled(boolean) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

Whether 'Expect: 100-continue' handshake is enabled.

setExtensions(Set<String>) - Method in class com.norconex.crawler.core.doc.operations.filter.impl.ExtensionReferenceFilterConfig

setExtract(String) - Method in class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractorConfig.LinkSelector

setExtract(String) - Method in class com.norconex.importer.handler.condition.impl.DomConditionConfig

Sets what should be extracted for the value.

setExtract(String) - Method in class com.norconex.importer.handler.transformer.impl.DomOperation

setExtractBetweens(List<HtmlLinkExtractorConfig.RegexPair>) - Method in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractorConfig

Sets the patterns delimiting the portions of a document to be considered for link extraction.

setExtractionPatterns(List<RegexFieldValueExtractor>) - Method in class com.norconex.importer.handler.transformer.impl.ExternalTransformerConfig

Sets metadata extraction patterns.

setExtractSelectors(List<String>) - Method in class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractorConfig

Only apply link selectors to portions of a document matching the supplied selectors.

setExtractSelectors(List<String>) - Method in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractorConfig

Sets the selectors matching the portions of a document to be considered for link extraction.

setFactor(Double) - Method in class com.norconex.importer.handler.transformer.impl.ImageTransformerConfig.Scale

setFailOnDeleteNotFound(boolean) - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig

Whether a delete request targeting an item that does not exist in the index is treated as a failure.

setFallbackCharset(Charset) - Method in class com.norconex.crawler.web.fetch.util.GenericRedirectUrlProviderConfig

setFallbackLanguage(String) - Method in class com.norconex.importer.handler.transformer.impl.LanguageTransformerConfig

The fallback language when none are detected.

setFallbackStrategy(SpoiledReferenceStrategy) - Method in class com.norconex.crawler.core.doc.operations.spoil.impl.GenericSpoiledReferenceStrategizerConfig

setFetchers(List<Fetcher>) - Method in class com.norconex.crawler.core.CrawlerConfig

One or more fetchers responsible for pulling documents and document metadata associated with a reference from a source.

setFetchersMaxRetries(int) - Method in class com.norconex.crawler.core.CrawlerConfig

The maximum number of times a fetcher will re-attempt fetching a resource in case of failures.

setFetchersRetryDelay(Duration) - Method in class com.norconex.crawler.core.CrawlerConfig

How long to wait before a failing fetcher re-attempts fetching a resource in case of failures (in milliseconds).

setField(String) - Method in class com.norconex.committer.core.fs.impl.CsvColumn

setField(String) - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.StructuredDataMapping

Metadata/structured-data field name this mapping applies to.

setFieldMapping(String, String) - Method in class com.norconex.committer.core.BaseCommitterConfig

Sets a metadata field mapping.

setFieldMappings(Map<String, String>) - Method in class com.norconex.committer.core.BaseCommitterConfig

Sets a metadata field mappings, where the key is the source field and the value is the target field.

setFieldMatcher(TextMatcher) - Method in class com.norconex.committer.core.impl.LogCommitterConfig

setFieldMatcher(TextMatcher) - Method in class com.norconex.committer.core.impl.MemoryCommitterConfig

setFieldMatcher(TextMatcher) - Method in class com.norconex.crawler.core.doc.operations.checksum.impl.GenericMetadataChecksummerConfig

setFieldMatcher(TextMatcher) - Method in class com.norconex.crawler.core.doc.operations.checksum.impl.Md5DocumentChecksummerConfig

setFieldMatcher(TextMatcher) - Method in class com.norconex.crawler.core.doc.operations.filter.impl.GenericMetadataFilterConfig

Sets the field matcher.

setFieldMatcher(TextMatcher) - Method in class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractorConfig

setFieldMatcher(TextMatcher) - Method in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractorConfig

setFieldMatcher(TextMatcher) - Method in class com.norconex.crawler.web.doc.operations.link.impl.TikaLinkExtractorConfig

setFieldMatcher(TextMatcher) - Method in class com.norconex.crawler.web.doc.operations.link.impl.XmlFeedLinkExtractorConfig

setFieldMatcher(TextMatcher) - Method in class com.norconex.importer.handler.condition.impl.BlankConditionConfig

setFieldMatcher(TextMatcher) - Method in class com.norconex.importer.handler.condition.impl.DateConditionConfig

Sets the text matcher of field names.

setFieldMatcher(TextMatcher) - Method in class com.norconex.importer.handler.condition.impl.DomConditionConfig

Sets this condition field matcher.

setFieldMatcher(TextMatcher) - Method in class com.norconex.importer.handler.condition.impl.NumericConditionConfig

Sets the text matcher of field names.

setFieldMatcher(TextMatcher) - Method in class com.norconex.importer.handler.condition.impl.ScriptConditionConfig

Sets this condition field matcher.

setFieldMatcher(TextMatcher) - Method in class com.norconex.importer.handler.condition.impl.TextConditionConfig

Sets the text matcher of field names.

setFieldMatcher(TextMatcher) - Method in class com.norconex.importer.handler.splitter.impl.CsvSplitterConfig

setFieldMatcher(TextMatcher) - Method in class com.norconex.importer.handler.splitter.impl.DomSplitterConfig

setFieldMatcher(TextMatcher) - Method in class com.norconex.importer.handler.splitter.impl.TranslatorSplitterConfig

setFieldMatcher(TextMatcher) - Method in class com.norconex.importer.handler.splitter.impl.XmlStreamSplitterConfig

setFieldMatcher(TextMatcher) - Method in class com.norconex.importer.handler.transformer.impl.CharacterCaseTransformerConfig

Optional matcher of fields to apply transformation to.

setFieldMatcher(TextMatcher) - Method in class com.norconex.importer.handler.transformer.impl.CharsetTransformerConfig

Set field matcher.

setFieldMatcher(TextMatcher) - Method in class com.norconex.importer.handler.transformer.impl.CollapseRepeatingTransformerConfig

Sets source field matcher for fields on which to perform repeating string collapsing.

setFieldMatcher(TextMatcher) - Method in class com.norconex.importer.handler.transformer.impl.CountMatchesTransformerConfig

Sets the field matcher.

setFieldMatcher(TextMatcher) - Method in class com.norconex.importer.handler.transformer.impl.DeleteTransformerConfig

Sets the field matcher for fields to delete.

setFieldMatcher(TextMatcher) - Method in class com.norconex.importer.handler.transformer.impl.DomTransformerConfig

setFieldMatcher(TextMatcher) - Method in class com.norconex.importer.handler.transformer.impl.ForceSingleValueTransformerConfig

Sets field matcher.

setFieldMatcher(TextMatcher) - Method in class com.norconex.importer.handler.transformer.impl.KeepOnlyTransformerConfig

Sets field matcher.

setFieldMatcher(TextMatcher) - Method in class com.norconex.importer.handler.transformer.impl.LanguageTransformerConfig

Sets a matcher for fields to use to detect language.

setFieldMatcher(TextMatcher) - Method in class com.norconex.importer.handler.transformer.impl.MergeOperation

Sets field matcher.

setFieldMatcher(TextMatcher) - Method in class com.norconex.importer.handler.transformer.impl.RegexTransformerConfig

Sets source field matcher for fields on which to extract fields/values.

setFieldMatcher(TextMatcher) - Method in class com.norconex.importer.handler.transformer.impl.RenameOperation

Sets source field matcher for fields to rename to the value of "toField".

setFieldMatcher(TextMatcher) - Method in class com.norconex.importer.handler.transformer.impl.ReplaceOperation

Sets field matcher.

setFieldMatcher(TextMatcher) - Method in class com.norconex.importer.handler.transformer.impl.ScriptTransformerConfig

Sets source field matcher for fields on which to execute a script.

setFieldMatcher(TextMatcher) - Method in class com.norconex.importer.handler.transformer.impl.SplitOperation

Sets the field matcher for fields to split.

setFieldMatcher(TextMatcher) - Method in class com.norconex.importer.handler.transformer.impl.StripAfterTransformerConfig

Sets source field matcher for fields to transform.

setFieldMatcher(TextMatcher) - Method in class com.norconex.importer.handler.transformer.impl.StripBeforeTransformerConfig

Sets source field matcher for fields to transform.

setFieldMatcher(TextMatcher) - Method in class com.norconex.importer.handler.transformer.impl.StripBetweenTransformerConfig

Sets source field matcher for fields to transform.

setFieldMatcher(TextMatcher) - Method in class com.norconex.importer.handler.transformer.impl.SubstringTransformerConfig

Sets source field matcher for fields to transform.

setFieldMatcher(TextMatcher) - Method in class com.norconex.importer.handler.transformer.impl.TextBetweenOperation

Sets field matcher for fields on which to extract values.

setFieldMatcher(TextMatcher) - Method in class com.norconex.importer.handler.transformer.impl.TextStatisticsTransformerConfig

Sets the field matcher for fields to split.

setFieldMatcher(TextMatcher) - Method in class com.norconex.importer.handler.transformer.impl.TitleGeneratorTransformerConfig

Sets source field matcher for fields to use to generate title.

setFieldMatcher(TextMatcher) - Method in class com.norconex.importer.handler.transformer.impl.TruncateTransformerConfig

Sets the field matcher for fields to truncate.

setFieldMatcher(TextMatcher) - Method in class com.norconex.importer.handler.transformer.impl.UrlExtractorTransformerConfig

Sets the field matcher for fields containing text.

setFieldName(String) - Method in class com.norconex.importer.handler.transformer.impl.BinaryContentTransformerConfig

Name of the metadata field to store the Base64-encoded raw content in.

setFile(boolean) - Method in class com.norconex.crawler.fs.fetch.FsPath

setFile(boolean) - Method in class com.norconex.crawler.fs.fetch.impl.GenericFileFetchResponse

setFile(boolean) - Method in class com.norconex.crawler.fs.ledger.FsCrawlerEntry

setFile(Path) - Method in class com.norconex.importer.handler.transformer.impl.FieldReportTransformerConfig

setFileNameEncoding(String) - Method in class com.norconex.crawler.fs.fetch.impl.sftp.SftpFetcherConfig

setFileNamePrefix(String) - Method in class com.norconex.committer.core.fs.BaseFsCommitterConfig

The file name prefix (default is null).

setFileNamePrefix(String) - Method in class com.norconex.crawler.web.event.listeners.UrlStatusCrawlerEventListenerConfig

The generated report file name prefix.

setFileNameSuffix(String) - Method in class com.norconex.committer.core.fs.BaseFsCommitterConfig

The file name suffix (default is null).

setFilter(String) - Method in class com.norconex.importer.handler.parser.impl.OcrConfig

setFixBadIds(boolean) - Method in class com.norconex.committer.amazoncloudsearch.AmazonCloudSearchCommitterConfig

Whether to fix IDs that are too long for CloudSearch ID limitation (128 characters max).

setFixBadIds(boolean) - Method in class com.norconex.committer.elasticsearch.ElasticsearchCommitterConfig

Whether to fix IDs that are too long for Elasticsearch ID limitation (512 bytes max).

setFixFieldNames(boolean) - Method in class com.norconex.committer.sql.SqlCommitterConfig

Whether to attempt preventing insertion errors by converting characters that are not underscores or alphanumeric to underscores.

setFixFieldValues(boolean) - Method in class com.norconex.committer.sql.SqlCommitterConfig

Attempts to prevent insertion errors by truncating values that are larger than their defined maximum field length.

setFolder(boolean) - Method in class com.norconex.crawler.fs.fetch.FsPath

setFolder(boolean) - Method in class com.norconex.crawler.fs.fetch.impl.GenericFileFetchResponse

setFolder(boolean) - Method in class com.norconex.crawler.fs.ledger.FsCrawlerEntry

setFollowRedirect(boolean) - Method in class com.norconex.crawler.fs.fetch.impl.webdav.WebDavFetcherConfig

setForceCharsetDetection(boolean) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

Whether character encoding is detected instead of relying on the charset sometimes found in the Content-Type HTTP response header.

setForceContentTypeDetection(boolean) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

Whether content type is detected instead of relying on returned Content-Type HTTP response header.

setForcePathStyle(boolean) - Method in class com.norconex.crawler.fs.fetch.impl.s3.S3FetcherConfig

Whether to use path-style bucket addressing (endpoint/bucket/key) instead of the AWS-default virtual-hosted style (bucket.endpoint/key).

setFormat(CsvFileCommitterConfig.CsvFormat) - Method in class com.norconex.committer.core.fs.impl.CsvFileCommitterConfig

Optional base CSV formatter to use.

setFormat(String) - Method in class com.norconex.importer.handler.condition.impl.DateConditionConfig

The format of a document date field value (see class documentation).

setFormat(String) - Method in class com.norconex.importer.handler.transformer.impl.CurrentDateTransformerConfig

setFormCharset(Charset) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthConfig

The authentication form character set for the form field values.

setFormParam(String, String) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthConfig

Sets an authentication form parameter (equivalent to "input" or other fields in HTML forms).

setFormParams(Map<String, String>) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthConfig

Sets authentication form parameters (equivalent to "input" or other fields in HTML forms).

setFormPasswordField(String) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthConfig

The name of the HTML field where the password is set.

setFormSelector(String) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthConfig

The CSS selector that identifies the form in a login page.

setFormUsernameField(String) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthConfig

The name of the HTML field where the username is set.

setFromField(String) - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.AclInheritanceMapping

Metadata field holding the parent item reference.

setFromField(String) - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.AclMapping

Metadata field holding the principal value(s).

setFromField(String) - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.MetadataMapping

Optional source metadata field in crawler documents.

setFromField(String) - Method in class com.norconex.importer.handler.transformer.impl.DateFormatTransformerConfig

setFromField(String) - Method in class com.norconex.importer.handler.transformer.impl.HierarchyOperation

setFromField(String) - Method in class com.norconex.importer.handler.transformer.impl.TitleGeneratorTransformerConfig

setFromFormats(List<String>) - Method in class com.norconex.importer.handler.transformer.impl.DateFormatTransformerConfig

Sets the source date formats to match.

setFromLocale(Locale) - Method in class com.norconex.importer.handler.transformer.impl.DateFormatTransformerConfig

The locale used for parsing the source date.

setFromSeparator(String) - Method in class com.norconex.importer.handler.transformer.impl.HierarchyOperation

setFromSitemap(boolean) - Method in class com.norconex.crawler.web.ledger.WebCrawlerEntry

Whether this record was obtained from parsing a sitemap.

setGraphBaseUrl(String) - Method in class com.norconex.crawler.fs.fetch.impl.m365graph.M365GraphFetcherConfig

Microsoft Graph v1 endpoint root.

setHandlers(List<DocHandler>) - Method in class com.norconex.importer.ImporterConfig

setHazelcastInstance(HazelcastInstance) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.jdbc.TypedJdbcMapStoreFactory

setHazelcastInstance(HazelcastInstance) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.jdbc.TypedJdbcQueueStoreFactory

setHazelcastInstance(HazelcastInstance) - Method in interface com.norconex.crawler.core.cluster.impl.hazelcast.LazyTypedStoreFactory

setHazelcastProperties(Map<String, String>) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.JdbcHazelcastConfigurer

Additional Hazelcast system properties set on the config (e.g.

setHeader(String) - Method in class com.norconex.committer.core.fs.impl.CsvColumn

setHeadersPrefix(String) - Method in class com.norconex.crawler.web.doc.operations.robot.impl.StandardRobotsMetaProviderConfig

setHeadersPrefix(String) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

Optional prefix prepended to captured HTTP response fields.

setHeadless(boolean) - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcherConfig

Whether to run the browser in headless mode.

setHeight(Integer) - Method in class com.norconex.importer.handler.transformer.impl.ImageTransformerConfig.Crop

setHeight(Integer) - Method in class com.norconex.importer.handler.transformer.impl.ImageTransformerConfig.Scale

setHost(Host) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthConfig

The host for the current authentication scope.

setHost(String) - Method in class com.norconex.crawler.web.fetch.impl.webdriver.HttpSnifferConfig

The host name passed to the browser pointing to the sniffer proxy.

setHostnameVerificationEnabled(boolean) - Method in class com.norconex.crawler.fs.fetch.impl.webdav.WebDavFetcherConfig

setHstsDisabled(boolean) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

Gets whether the forcing of non secure URLs to secure ones is disabled, according to the URL domain Strict-Transport-Security policy (obtained from HTTP response header).

setHttpBackoffInitialIntervalMillis(int) - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig

Optional exponential backoff initial interval in milliseconds.

setHttpBackoffMaxElapsedTimeMillis(int) - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig

Optional exponential backoff maximum elapsed time in milliseconds.

setHttpBackoffMaxIntervalMillis(int) - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig

Optional exponential backoff maximum interval in milliseconds.

setHttpConnectTimeoutMillis(int) - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig

Optional HTTP connect timeout in milliseconds applied to Google API requests.

setHttpMaxRetries(int) - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig

Optional HTTP retry count for Google API requests.

setHttpMethods(List<HttpMethod>) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

Sets the list of HTTP methods to be accepted by this fetcher.

setHttpReadTimeoutMillis(int) - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig

Optional HTTP read timeout in milliseconds applied to Google API requests.

setHttpReasonPhrase(String) - Method in class com.norconex.crawler.web.ledger.WebCrawlerEntry

HTTP reason phrase from the last fetch response.

setHttpSniffer(HttpSniffer) - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig

Optionally setup an HTTP proxy that allows to set and capture HTTP headers.

setHttpStatusCode(int) - Method in class com.norconex.crawler.web.ledger.WebCrawlerEntry

HTTP status code from the last fetch response.

setId(String) - Method in class com.norconex.crawler.core.CrawlerConfig

The crawler unique identifier.

setIdleTimeout(Duration) - Method in class com.norconex.crawler.core.CrawlerConfig

The maximum amount of time to wait before shutting down an idle crawler.

setIfModifiedSinceDisabled(boolean) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

Whether adding the If-Modified-Since HTTP request header is disabled.

setIgnoreCase(boolean) - Method in class com.norconex.crawler.core.doc.operations.filter.impl.ExtensionReferenceFilterConfig

setIgnoreCase(boolean) - Method in class com.norconex.importer.handler.transformer.impl.CollapseRepeatingTransformerConfig

Sets whether to ignore case sensitivity.

setIgnoreContent(boolean) - Method in class com.norconex.committer.core.impl.LogCommitterConfig

setIgnoreContent(boolean) - Method in class com.norconex.committer.core.impl.MemoryCommitterConfig

setIgnoreErrors(boolean) - Method in class com.norconex.committer.core.batch.queue.impl.FsQueueConfig.OnCommitFailure

Whether to ignore non-critical errors in an attempt to keep going.

setIgnoreHttpsErrors(boolean) - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcherConfig

When true, HTTPS certificate errors are ignored.

setIgnoreLinkData(boolean) - Method in class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractorConfig

Whether to ignore extra data associated with a link.

setIgnoreLinkData(boolean) - Method in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractorConfig

Gets whether to ignore extra data associated with a link.

setIgnoreLinkData(boolean) - Method in class com.norconex.crawler.web.doc.operations.link.impl.TikaLinkExtractorConfig

Whether to ignore extra data associated with a link.

setIgnoreNofollow(boolean) - Method in class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractorConfig

setIgnoreNofollow(boolean) - Method in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractorConfig

Whether to ignore "nofollow" directives on HTML links.

setIgnoreNofollow(boolean) - Method in class com.norconex.crawler.web.doc.operations.link.impl.TikaLinkExtractorConfig

setIgnoreNonTranslatedFields(boolean) - Method in class com.norconex.importer.handler.splitter.impl.TranslatorSplitterConfig

Whether to ignore fields not translated when creating child documents.

setIgnoreResponseErrors(boolean) - Method in class com.norconex.committer.azurecognitivesearch.AzureSearchCommitterConfig

Whether to ignore response errors.

setIgnoreResponseErrors(boolean) - Method in class com.norconex.committer.elasticsearch.ElasticsearchCommitterConfig

Whether to ignore response errors.

setIgnoreRobotsCrawlDelay(boolean) - Method in class com.norconex.crawler.web.doc.operations.delay.impl.BaseDelayResolverConfig

Whether to ignore crawl delays specified in a site robots.txt file.

setIgnoreValidationErrors(boolean) - Method in class com.norconex.committer.azurecognitivesearch.AzureSearchCommitterConfig

Whether to ignore validation errors.

setImage(FeaturedImage) - Method in class com.norconex.crawler.web.doc.operations.image.impl.ImageCache

Stores a featured image in the cache as a PNG-compressed byte array, keyed by its URL.

setImageCacheSize(int) - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig

Maximum number of images to cache in memory for faster processing.

setImageFormat(String) - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig

Target format of stored image.

setImageFormat(String) - Method in class com.norconex.crawler.web.fetch.util.DocImageHandlerConfig

setImageMagickPath(Path) - Method in class com.norconex.importer.handler.parser.impl.OcrConfig

setImplicitlyWait(Duration) - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig

Web driver max wait time for an element to appear.

setImporterConfig(ImporterConfig) - Method in class com.norconex.crawler.core.CrawlerConfig

The Importer module configuration.

setImporterResponse(ImporterResponse) - Method in class com.norconex.crawler.core.doc.pipelines.importer.ImporterPipelineContext

setIncludeSubdomains(boolean) - Method in class com.norconex.crawler.web.doc.operations.scope.impl.GenericUrlScopeResolverConfig

Whether sub-domains are considered to be the same as a URL domain.

setInclusive(boolean) - Method in class com.norconex.importer.handler.transformer.impl.StripAfterTransformerConfig

Whether the match itself should be stripped or not.

setInclusive(boolean) - Method in class com.norconex.importer.handler.transformer.impl.StripBeforeTransformerConfig

Whether the match itself should be stripped or not.

setInclusive(boolean) - Method in class com.norconex.importer.handler.transformer.impl.StripBetweenOperation

setInclusive(boolean) - Method in class com.norconex.importer.handler.transformer.impl.TextBetweenOperation

setIndent(int) - Method in class com.norconex.committer.core.fs.impl.JsonFileCommitterConfig

setIndent(int) - Method in class com.norconex.committer.core.fs.impl.XmlFileCommitterConfig

setIndexName(String) - Method in class com.norconex.committer.azurecognitivesearch.AzureSearchCommitterConfig

The target index name.

setIndexName(String) - Method in class com.norconex.committer.elasticsearch.ElasticsearchCommitterConfig

The Elasticsearch index name.

setInitialLoadMode(MapStoreConfig.InitialLoadMode) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.JdbcHazelcastConfigurer

Hazelcast map-store initial load mode.

setInputStream(InputStream) - Method in class com.norconex.importer.doc.Doc

setInstanceName(String) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastClusterConnectorConfig

Unique name for the Hazelcast instance.

setInteger(String, int) - Method in class com.norconex.crawler.core.session.CrawlerAttributes

Sets an attribute as an integer.

setIntegerIfAbsent(String, int) - Method in class com.norconex.crawler.core.session.CrawlerAttributes

Atomically sets an attribute as an integer if it is not already set.

setIsoTimestamp(Properties, String, String, String) - Static method in class com.norconex.crawler.fs.fetch.impl.FetcherSupport

setJdbcDriver(String) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.JdbcHazelcastConfigurer

JDBC driver class name.

setJdbcPassword(String) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.JdbcHazelcastConfigurer

JDBC password.

setJdbcUrl(String) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.JdbcHazelcastConfigurer

JDBC URL for the data source.

setJdbcUsername(String) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.JdbcHazelcastConfigurer

JDBC username.

setJetEnabled(Boolean) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.JdbcHazelcastConfigurer

Whether Hazelcast Jet engine should be enabled.

setJson(String) - Method in class com.norconex.crawler.core.cluster.SerializedCache.SerializedEntry

setJsonFieldsPattern(String) - Method in class com.norconex.committer.elasticsearch.ElasticsearchCommitterConfig

The regular expression matching fields that contains a JSON object for its value (as opposed to a regular string).

setKeep(boolean) - Method in class com.norconex.crawler.core.doc.operations.checksum.BaseChecksummerConfig

Whether to keep the metadata checksum value as a new metadata field.

setKeepAlive(boolean) - Method in class com.norconex.crawler.fs.fetch.impl.webdav.WebDavFetcherConfig

setKeepBadDates(boolean) - Method in class com.norconex.importer.handler.transformer.impl.DateFormatTransformerConfig

setKeepEmptySegments(boolean) - Method in class com.norconex.importer.handler.transformer.impl.HierarchyOperation

setKeepFromField(boolean) - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.MetadataMapping

Whether to keep GoogleCloudSearchCommitterConfig.MetadataMapping.fromField in structured data.

setKeepProbabilities(boolean) - Method in class com.norconex.importer.handler.transformer.impl.LanguageTransformerConfig

Whether to keep the match probabilities for each languages detected.

setKeepReferencedLinks(Set<WebCrawlerConfig.ReferencedLinkType>) - Method in class com.norconex.crawler.web.WebCrawlerConfig

Sets whether to keep referenced links and what to keep.

setKeepSourceIdField(boolean) - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig

Whether to keep the source ID field in the document metadata after it has been extracted.

setKerberosConfig(KerberosConfig) - Method in class com.norconex.crawler.fs.fetch.impl.hdfs.HdfsFetcherConfig

Kerberos/SPNEGO configuration.

setKerberosConfig(KerberosConfig) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthConfig

Kerberos/SPNEGO configuration.

setKey(String) - Method in class com.norconex.crawler.core.cluster.SerializedCache.SerializedEntry

setKeyStoreFile(String) - Method in class com.norconex.crawler.fs.fetch.impl.webdav.WebDavFetcherConfig

setKeyStorePass(String) - Method in class com.norconex.crawler.fs.fetch.impl.webdav.WebDavFetcherConfig

setKeyStorePassKey(EncryptionKey) - Method in class com.norconex.crawler.fs.fetch.impl.webdav.WebDavFetcherConfig

setKeyStoreType(String) - Method in class com.norconex.crawler.fs.fetch.impl.webdav.WebDavFetcherConfig

setKeytabPath(Path) - Method in class com.norconex.crawler.fs.fetch.impl.hdfs.KerberosConfig

Path to a keytab file containing the principal's key.

setKeytabPath(Path) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.KerberosConfig

Path to a keytab file containing the principal's key.

setKnownHosts(File) - Method in class com.norconex.crawler.fs.fetch.impl.sftp.SftpFetcherConfig

setKrb5ConfigPath(Path) - Method in class com.norconex.crawler.fs.fetch.impl.hdfs.KerberosConfig

Path to the Kerberos configuration file (krb5.conf).

setKrb5ConfigPath(Path) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.KerberosConfig

Path to the Kerberos configuration file (krb5.conf).

setLabel(String) - Method in class com.norconex.importer.handler.BaseLabelableConfig

setLabel(String) - Method in class com.norconex.importer.handler.condition.ConditionalDocHandler

setLabel(String) - Method in class com.norconex.importer.handler.condition.ConditionGroup

setLanguage(String) - Method in class com.norconex.importer.handler.parser.impl.OcrConfig

setLanguages(List<String>) - Method in class com.norconex.importer.handler.transformer.impl.LanguageTransformerConfig

The language candidates for language detection.

setLargest(boolean) - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig

When more than one featured image is found, whether to return the largest of them all (as opposed to the first one encountered).

setLastModified(ZonedDateTime) - Method in class com.norconex.crawler.core.ledger.CrawlerEntry

setLastModified(ZonedDateTime) - Method in class com.norconex.crawler.web.doc.operations.sitemap.SitemapRecord

setLastUpdated(long) - Method in class com.norconex.crawler.core.session.CrawlerSession.State

setLatePageScript(String) - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcherConfig

Optional JavaScript code executed after all wait conditions have been satisfied.

setLatePageScript(String) - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig

Optional JavaScript code to be run after we are done waiting for a page.

setLenient(boolean) - Method in class com.norconex.crawler.web.doc.operations.sitemap.impl.GenericSitemapResolverConfig

setLinesToSkip(int) - Method in class com.norconex.importer.handler.splitter.impl.CsvSplitterConfig

The number of lines to skip before starting to parse lines.

setLinkExtractors(List<LinkExtractor>) - Method in class com.norconex.crawler.web.WebCrawlerConfig

Sets link extractors.

setLocalAddress(String) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

The local address, which may be useful when working with multiple network interfaces.

setLocale(Locale) - Method in class com.norconex.importer.handler.transformer.impl.CurrentDateTransformerConfig

The locale used for formatting.

setLocation(String) - Method in class com.norconex.crawler.web.doc.operations.sitemap.SitemapRecord

setLogContent(boolean) - Method in class com.norconex.importer.handler.transformer.impl.DebugTransformerConfig

setLogFields(List<String>) - Method in class com.norconex.importer.handler.transformer.impl.DebugTransformerConfig

setLoginModuleName(String) - Method in class com.norconex.crawler.fs.fetch.impl.hdfs.KerberosConfig

The JAAS login module name.

setLoginModuleName(String) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.KerberosConfig

The JAAS login module name.

setLogLevel(LogCommitterConfig.LogLevel) - Method in class com.norconex.committer.core.impl.LogCommitterConfig

setLogLevel(String) - Method in class com.norconex.importer.handler.transformer.impl.DebugTransformerConfig

setMapping(ProcessingOutcome, SpoiledReferenceStrategy) - Method in class com.norconex.crawler.core.doc.operations.spoil.impl.GenericSpoiledReferenceStrategizerConfig

setMappings(Map<ProcessingOutcome, SpoiledReferenceStrategy>) - Method in class com.norconex.crawler.core.doc.operations.spoil.impl.GenericSpoiledReferenceStrategizerConfig

setMatch(String) - Method in class com.norconex.crawler.web.doc.operations.link.impl.RegexLinkExtractorConfig.ExtractionPattern

setMatchAnyBlank(boolean) - Method in class com.norconex.importer.handler.condition.impl.BlankConditionConfig

setMatchBlanks(boolean) - Method in class com.norconex.importer.handler.transformer.impl.DomOperation

The gets whether elements with blank values should be considered a match and have an empty string returned as opposed to nothing at all.

setMatcher(TextMatcher) - Method in class com.norconex.crawler.web.doc.operations.recrawl.impl.GenericRecrawlableResolverConfig.MinFrequency

setMaxBufferSize(int) - Method in class com.norconex.crawler.web.fetch.impl.webdriver.HttpSnifferConfig

Maximum byte size before a request/response content is considered too large.

setMaxConnectionIdleTime(Duration) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

Sets the period of time after which to evict idle connections from the connection pool.

setMaxConnectionInactiveTime(Duration) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

Sets the period of time a connection must be inactive to be checked in case it became stalled.

setMaxConnections(int) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

The maximum number of connections that can be created.

setMaxConnectionsPerHost(int) - Method in class com.norconex.crawler.fs.fetch.impl.webdav.WebDavFetcherConfig

setMaxConnectionsPerRoute(int) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

The maximum number of connections that can be used per route.

setMaxCrawlDuration(Duration) - Method in class com.norconex.crawler.core.CrawlerConfig

The maximum amount of time a crawler is allowed to run.

setMaxDepth(int) - Method in class com.norconex.crawler.core.CrawlerConfig

The maximum depth the crawler should go.

setMaxDocuments(int) - Method in class com.norconex.crawler.core.CrawlerConfig

The maximum number of documents that can be processed in a single crawler run before stopping.

setMaxEmbeddedDepth(int) - Method in class com.norconex.importer.handler.parser.impl.EmbeddedConfig

Maximum detph of embeded documents to extract.

setMaxFileSizeToOcr(Long) - Method in class com.norconex.importer.handler.parser.impl.OcrConfig

setMaximum(long) - Method in class com.norconex.crawler.core.event.listeners.StopCrawlerOnMaxEventListenerConfig

The maximum number of events matching the event matcher on which we stop the crawler.

setMaxLength(int) - Method in class com.norconex.importer.handler.transformer.impl.TruncateTransformerConfig

setMaxMemoryInstance(long) - Method in class com.norconex.importer.ImporterConfig

The maximum number of bytes used for memory caching of a single documents being processed.

setMaxMemoryPool(long) - Method in class com.norconex.importer.ImporterConfig

The maximum number of bytes used for memory caching of data for all documents concurrently being processed.

setMaxPathLength(int) - Method in class com.norconex.importer.handler.transformer.impl.SaveDocumentTransformerConfig

setMaxPerFolder(int) - Method in class com.norconex.committer.core.batch.queue.impl.FsQueueConfig

The maximum number of files to be queued on disk in a given folders.

setMaxPoolSize(int) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.JdbcHazelcastConfigurer

Maximum JDBC connection pool size.

setMaxQueueBatchSize(int) - Method in class com.norconex.crawler.core.CrawlerConfig

The maximum number of references a node will read at once from the queue, to process locally.

setMaxReadSize(int) - Method in class com.norconex.importer.handler.condition.impl.ScriptConditionConfig

The maximum number of characters to read at once, used for filtering.

setMaxReadSize(int) - Method in class com.norconex.importer.handler.condition.impl.TextConditionConfig

The maximum number of characters to read at once, used for filtering.

setMaxReadSize(int) - Method in class com.norconex.importer.handler.transformer.impl.CollapseRepeatingTransformerConfig

setMaxReadSize(int) - Method in class com.norconex.importer.handler.transformer.impl.CountMatchesTransformerConfig

The maximum number of characters to read from content for tagging at once.

setMaxReadSize(int) - Method in class com.norconex.importer.handler.transformer.impl.LanguageTransformerConfig

setMaxReadSize(int) - Method in class com.norconex.importer.handler.transformer.impl.RegexTransformerConfig

setMaxReadSize(int) - Method in class com.norconex.importer.handler.transformer.impl.ReplaceTransformerConfig

setMaxReadSize(int) - Method in class com.norconex.importer.handler.transformer.impl.ScriptTransformerConfig

setMaxReadSize(int) - Method in class com.norconex.importer.handler.transformer.impl.StripAfterTransformerConfig

setMaxReadSize(int) - Method in class com.norconex.importer.handler.transformer.impl.StripBeforeTransformerConfig

setMaxReadSize(int) - Method in class com.norconex.importer.handler.transformer.impl.StripBetweenTransformerConfig

setMaxReadSize(int) - Method in class com.norconex.importer.handler.transformer.impl.TextBetweenTransformerConfig

setMaxReadSize(int) - Method in class com.norconex.importer.handler.transformer.impl.TitleGeneratorTransformerConfig

setMaxReadSize(int) - Method in class com.norconex.importer.handler.transformer.impl.UrlExtractorTransformerConfig

The maximum number of characters to read from content for tagging at once.

setMaxRedirects(int) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

The maximum number of redirects to be followed.

setMaxRetries(int) - Method in class com.norconex.committer.core.batch.queue.impl.FsQueueConfig.OnCommitFailure

Maximum retries upon commit failures.

setMaxSamples(int) - Method in class com.norconex.importer.handler.transformer.impl.FieldReportTransformerConfig

setMaxStreamCachePoolSize(long) - Method in class com.norconex.crawler.core.CrawlerConfig

Maximum number of bytes used for memory caching of all reusable streams combined, at any given time, for faster processing.

setMaxStreamCacheSize(long) - Method in class com.norconex.crawler.core.CrawlerConfig

Maximum number of bytes used for memory caching of a single reusable stream, for faster processing.

setMaxTotalConnections(int) - Method in class com.norconex.crawler.fs.fetch.impl.webdav.WebDavFetcherConfig

setMaxUrlLength(int) - Method in class com.norconex.crawler.web.doc.operations.link.impl.RegexLinkExtractorConfig

The maximum supported URL length.

setMaxURLLength(int) - Method in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractorConfig

The maximum supported URL length.

setMdcCrawlerId(String) - Static method in class com.norconex.crawler.core.util.LogUtil

Sets two representations of the supplied crawler ID to the Mapped Diagnostic Context (MDC) for logging implementations supporting it:

setMessage(String) - Method in class com.norconex.importer.handler.RejectConfig

setMetaChecksum(String) - Method in class com.norconex.crawler.core.ledger.CrawlerEntry

setMetadata(Properties) - Method in class com.norconex.crawler.web.doc.operations.link.Link

setMetadata(Properties) - Method in class com.norconex.importer.doc.Doc

setMetadata(Properties) - Method in class com.norconex.importer.ImporterRequest

setMetadataChecksummer(MetadataChecksummer) - Method in class com.norconex.crawler.core.CrawlerConfig

The metadata checksummer.

setMetadataDeduplicate(boolean) - Method in class com.norconex.crawler.core.CrawlerConfig

Whether to turn ON deduplication based on metadata checksum.

setMetadataFetchSupport(FetchDirectiveSupport) - Method in class com.norconex.crawler.core.CrawlerConfig

setMetadataFilters(List<MetadataFilter>) - Method in class com.norconex.crawler.core.CrawlerConfig

Sets metadata filters.

setMetadataInputFormat(String) - Method in class com.norconex.importer.handler.transformer.impl.ExternalTransformerConfig

setMetadataMappings(List<GoogleCloudSearchCommitterConfig.MetadataMapping>) - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig

setMetadataOutputFormat(String) - Method in class com.norconex.importer.handler.transformer.impl.ExternalTransformerConfig

setMethod(HttpAuthMethod) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthConfig

The authentication method.

setMinDimensions(Dimension) - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig

Minimum pixel size for an image to be considered.

setMinFileSizeToOcr(Long) - Method in class com.norconex.importer.handler.parser.impl.OcrConfig

setMinFrequencies(Collection<GenericRecrawlableResolverConfig.MinFrequency>) - Method in class com.norconex.crawler.web.doc.operations.recrawl.impl.GenericRecrawlableResolverConfig

Sets minimum frequencies.

setMinProgressLoggingInterval(Duration) - Method in class com.norconex.crawler.core.CrawlerConfig

Minimum amount of time to wait between each logging of crawling progress.

setModelPath(String) - Method in class com.norconex.importer.handler.parser.impl.SentimentConfig

setMultiValueJoinDelimiter(String) - Method in class com.norconex.committer.core.fs.impl.CsvFileCommitterConfig

String used as delimiter when joining multi-value fields.

setMultiValuesJoiner(String) - Method in class com.norconex.committer.neo4j.Neo4jCommitterConfig

One or more characters to join multi-value fields.

setMultiValuesJoiner(String) - Method in class com.norconex.committer.sql.SqlCommitterConfig

One or more characters to join multi-value fields.

setNativeDocumentFormatPolicy(GoogleDriveFetcherConfig.NativeDocumentFormatPolicy) - Method in class com.norconex.crawler.fs.fetch.impl.googledrive.GoogleDriveFetcherConfig

Default export policy for Google-native document families when no explicit override is configured.

setNativeRetryBaseDelay(Duration) - Method in class com.norconex.crawler.fs.fetch.impl.m365graph.M365GraphFetcherConfig

Base delay for native retries when Retry-After is not provided.

setNativeRetryEnabled(boolean) - Method in class com.norconex.crawler.fs.fetch.impl.m365graph.M365GraphFetcherConfig

Whether to apply M365-native retry for throttling/transient statuses.

setNativeRetryMaxRetries(int) - Method in class com.norconex.crawler.fs.fetch.impl.m365graph.M365GraphFetcherConfig

Maximum native retries for status codes listed in M365GraphFetcherConfig.nativeRetryStatusCodes.

setNativeRetryStatusCodes(List<Integer>) - Method in class com.norconex.crawler.fs.fetch.impl.m365graph.M365GraphFetcherConfig

setNestedResponses(List<ImporterResponse>) - Method in class com.norconex.importer.response.ImporterResponse

setNetworkInterface(String) - Method in class com.norconex.crawler.web.fetch.impl.webdriver.HttpSnifferConfig

Network interface address (IP) to be used by the sniffer proxy to listen for incoming connections.

setNodeContentProperty(String) - Method in class com.norconex.committer.neo4j.Neo4jCommitterConfig

Optional property name where to store the document content in Neo4j graph entries.

setNodeExpiryTimeout(Duration) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastClusterConnectorConfig

Maximum amount of time to wait before declaring a node as "expired" when running a crawler task across multiple nodes.

setNodeIdProperty(String) - Method in class com.norconex.committer.neo4j.Neo4jCommitterConfig

Optional property name where to store the document reference in Neo4j graph entries.

setNodes(List<String>) - Method in class com.norconex.committer.elasticsearch.ElasticsearchCommitterConfig

Sets cluster node URLs.

setNoExtractBetweens(List<HtmlLinkExtractorConfig.RegexPair>) - Method in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractorConfig

Sets the patterns delimiting the portions of a document to be excluded from link extraction.

setNoExtractSelectors(List<String>) - Method in class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractorConfig

Do not apply link selectors to portions of a document matching the supplied selectors.

setNoExtractSelectors(List<String>) - Method in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractorConfig

Sets the selectors matching the portions of a document to be excluded from link extraction.

setNormalizations(List<GenericUrlNormalizerConfig.Normalization>) - Method in class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizerConfig

setNotFoundStatusCodes(List<Integer>) - Method in class com.norconex.crawler.fs.fetch.impl.box.BoxFetcherConfig

setNotFoundStatusCodes(List<Integer>) - Method in class com.norconex.crawler.fs.fetch.impl.egnyte.EgnyteFetcherConfig

setNotFoundStatusCodes(List<Integer>) - Method in class com.norconex.crawler.fs.fetch.impl.m365graph.M365GraphFetcherConfig

setNotFoundStatusCodes(List<Integer>) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

Sets HTTP status codes to be considered as "Not found" state.

setNumThreads(int) - Method in class com.norconex.crawler.core.CrawlerConfig

The maximum number of threads a crawler can use.

setObjectByPathTemplate(String) - Method in class com.norconex.crawler.fs.fetch.impl.cmis.CmisAtomSession

setOnMatch(OnMatch) - Method in class com.norconex.crawler.core.doc.operations.filter.impl.ExtensionReferenceFilterConfig

setOnMatch(OnMatch) - Method in class com.norconex.crawler.core.doc.operations.filter.impl.GenericMetadataFilterConfig

setOnMatch(OnMatch) - Method in class com.norconex.crawler.core.doc.operations.filter.impl.GenericReferenceFilterConfig

setOnMatch(OnMatch) - Method in class com.norconex.crawler.web.doc.operations.filter.impl.SegmentCountUrlFilterConfig

Action to undertake when there is a match.

setOnMultiple(StopCrawlerOnMaxEventListenerConfig.OnMultiple) - Method in class com.norconex.crawler.core.event.listeners.StopCrawlerOnMaxEventListenerConfig

setOnSet(PropertySetter) - Method in class com.norconex.crawler.core.doc.operations.checksum.BaseChecksummerConfig

The property setter to use when a value is set.

setOnSet(PropertySetter) - Method in class com.norconex.importer.handler.transformer.impl.ConstantTransformerConfig

Default property setter when a constant does not specify one.

setOnSet(PropertySetter) - Method in class com.norconex.importer.handler.transformer.impl.CopyTransformerConfig

Default property setter when an operation does not specify one.

setOnSet(PropertySetter) - Method in class com.norconex.importer.handler.transformer.impl.CountMatchesTransformerConfig

Gets the property setter to use when a value is set.

setOnSet(PropertySetter) - Method in class com.norconex.importer.handler.transformer.impl.CurrentDateTransformerConfig

The property setter to use when a value is set.

setOnSet(PropertySetter) - Method in class com.norconex.importer.handler.transformer.impl.DateFormatTransformerConfig

The property setter to use when a value is set.

setOnSet(PropertySetter) - Method in class com.norconex.importer.handler.transformer.impl.DocumentLengthTransformerConfig

Gets the property setter to use when a value is set.

setOnSet(PropertySetter) - Method in class com.norconex.importer.handler.transformer.impl.DomOperation

The gets the property setter to use when a value is set.

setOnSet(PropertySetter) - Method in class com.norconex.importer.handler.transformer.impl.ExternalTransformerConfig

Gets the property setter to use when a metadata value is set.

setOnSet(PropertySetter) - Method in class com.norconex.importer.handler.transformer.impl.HierarchyOperation

Gets the property setter to use when a value is set.

setOnSet(PropertySetter) - Method in class com.norconex.importer.handler.transformer.impl.RenameOperation

setOnSet(PropertySetter) - Method in class com.norconex.importer.handler.transformer.impl.ReplaceOperation

setOnSet(PropertySetter) - Method in class com.norconex.importer.handler.transformer.impl.SplitOperation

The property setter to use when a value is set.

setOnSet(PropertySetter) - Method in class com.norconex.importer.handler.transformer.impl.TextBetweenOperation

The property setter to use when a value is set.

setOnSet(PropertySetter) - Method in class com.norconex.importer.handler.transformer.impl.TitleGeneratorTransformerConfig

The property setter to use when a value is set.

setOnSet(PropertySetter) - Method in class com.norconex.importer.handler.transformer.impl.TruncateTransformerConfig

The property setter to use when a value is set.

setOnSet(PropertySetter) - Method in class com.norconex.importer.handler.transformer.impl.UrlExtractorTransformerConfig

The property setter to use when a value is set.

setOnSet(PropertySetter) - Method in class com.norconex.importer.handler.transformer.impl.UuidTransformerConfig

The property setter to use when a value is set.

setOperations(List<CopyOperation>) - Method in class com.norconex.importer.handler.transformer.impl.CopyTransformerConfig

setOperations(List<DomOperation>) - Method in class com.norconex.importer.handler.transformer.impl.DomTransformerConfig

setOperations(List<HierarchyOperation>) - Method in class com.norconex.importer.handler.transformer.impl.HierarchyTransformerConfig

setOperations(List<MergeOperation>) - Method in class com.norconex.importer.handler.transformer.impl.MergeTransformerConfig

setOperations(List<RenameOperation>) - Method in class com.norconex.importer.handler.transformer.impl.RenameTransformerConfig

setOperations(List<ReplaceOperation>) - Method in class com.norconex.importer.handler.transformer.impl.ReplaceTransformerConfig

setOperations(List<SplitOperation>) - Method in class com.norconex.importer.handler.transformer.impl.SplitTransformerConfig

setOperations(List<StripBetweenOperation>) - Method in class com.norconex.importer.handler.transformer.impl.StripBetweenTransformerConfig

setOperations(List<TextBetweenOperation>) - Method in class com.norconex.importer.handler.transformer.impl.TextBetweenTransformerConfig

setOptionalParameters(Set<String>) - Method in class com.norconex.committer.neo4j.Neo4jCommitterConfig

setOrphan(boolean) - Method in class com.norconex.crawler.core.ledger.CrawlerEntry

setOrphansStrategy(CrawlerConfig.OrphansStrategy) - Method in class com.norconex.crawler.core.CrawlerConfig

The strategy to adopt when there are orphans.

setOutputDir(Path) - Method in class com.norconex.crawler.web.event.listeners.UrlStatusCrawlerEventListenerConfig

The local directory where this listener report will be written.

setPageContentTypePattern(String) - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig

Optional regex to overwrite default matching of HTML pages.

setPageLoadTimeout(Duration) - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcherConfig

Maximum time to wait for the page load event.

setPageLoadTimeout(Duration) - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig

Web driver max wait time for a page to load.

setPageSegMode(String) - Method in class com.norconex.importer.handler.parser.impl.OcrConfig

setPageSeparator(String) - Method in class com.norconex.importer.handler.parser.impl.OcrConfig

setPageSplitSize(int) - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreClusterConnectorConfig

The page split size in bytes.

setParentReferences(List<String>) - Method in class com.norconex.importer.doc.Doc

setParser(String) - Method in class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractorConfig

The parser to use when creating the DOM-tree.

setParser(String) - Method in class com.norconex.importer.handler.condition.impl.DomConditionConfig

Sets the parser to use when creating the DOM-tree.

setParser(String) - Method in class com.norconex.importer.handler.splitter.impl.DomSplitterConfig

The type of parser to use when creating the DOM-tree.

setParser(String) - Method in class com.norconex.importer.handler.transformer.impl.DomTransformerConfig

The type of parser to use when creating the DOM-tree.

setPartitions(int) - Method in class com.norconex.committer.apachekafka.ApacheKafkaCommitterConfig

The number of partitions for the new topic.

setPassiveMode(boolean) - Method in class com.norconex.crawler.fs.fetch.impl.ftp.FtpFetcherConfig

setPath(String) - Method in class com.norconex.importer.handler.splitter.impl.XmlStreamSplitterConfig

setPaths(List<String>) - Method in class com.norconex.crawler.web.doc.operations.sitemap.impl.GenericSitemapLocatorConfig

Sets the URL paths, relative to the URL root, from which to try locate and resolve sitemaps.

setPathToField(String) - Method in class com.norconex.importer.handler.transformer.impl.SaveDocumentTransformerConfig

setPatterns(List<RegexFieldValueExtractor>) - Method in class com.norconex.importer.handler.transformer.impl.RegexTransformerConfig

Sets one or more patterns that will extract matching field names/values.

setPatterns(List<RegexLinkExtractorConfig.ExtractionPattern>) - Method in class com.norconex.crawler.web.doc.operations.link.impl.RegexLinkExtractorConfig

setPersistent(boolean) - Method in class com.norconex.crawler.core.cluster.SerializedCache

Whether this cache is persisted by the crawler between runs.

setPipelineId(String) - Method in class com.norconex.crawler.core.cluster.pipeline.StepRecord

setPort(int) - Method in class com.norconex.crawler.web.fetch.impl.webdriver.HttpSnifferConfig

The host port passed to the browser pointing to the sniffer proxy.

setPostCloseCleanup(Runnable) - Method in class com.norconex.crawler.core.session.CrawlerSession

Registers a cleanup action to run AFTER the session has closed all its resources.

setPostImportConsumers(List<DocumentConsumer>) - Method in class com.norconex.crawler.core.CrawlerConfig

Sets post-import consumers.

setPostImportLinks(TextMatcher) - Method in class com.norconex.crawler.web.WebCrawlerConfig

Set a field matcher used to identify post-import metadata fields holding URLs to consider for crawling.

setPostImportLinksKeep(boolean) - Method in class com.norconex.crawler.web.WebCrawlerConfig

Whether to keep the Importer-populated fields from WebCrawlerConfig.getPostImportLinks().

setPreemptive(boolean) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthConfig

Whether to perform preemptive authentication (valid for "basic" authentication method).

setPreemptiveAuth(boolean) - Method in class com.norconex.crawler.fs.fetch.impl.webdav.WebDavFetcherConfig

setPreferredAuthentications(String) - Method in class com.norconex.crawler.fs.fetch.impl.sftp.SftpFetcherConfig

setPrefix(String) - Method in class com.norconex.importer.handler.transformer.impl.DebugTransformerConfig

The prefix to print before the actual log message.

setPreImportConsumers(List<DocumentConsumer>) - Method in class com.norconex.crawler.core.CrawlerConfig

Sets pre-import consumers.

setPreserveInterwordSpacing(Boolean) - Method in class com.norconex.importer.handler.parser.impl.OcrConfig

setPrimaryKey(String) - Method in class com.norconex.committer.sql.SqlCommitterConfig

The name of the table primary key field where the document reference will be stored, unless it is already set by a field of the same name in the source document.

setPrincipal(String) - Method in class com.norconex.crawler.fs.fetch.impl.hdfs.KerberosConfig

The Kerberos principal name used for login (e.g.

setPrincipal(String) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.KerberosConfig

The Kerberos principal name used for login (e.g., user@REALM).

setPrincipalType(GoogleCloudSearchCommitterConfig.PrincipalType) - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.AclMapping

Type of principal the field value represents.

setPrivateKey(String) - Method in class com.norconex.crawler.fs.fetch.impl.googledrive.GoogleDriveFetcherConfig

PEM private key content or secure key reference.

setProcessedAt(ZonedDateTime) - Method in class com.norconex.crawler.core.ledger.CrawlerEntry

setProcessingAt(ZonedDateTime) - Method in class com.norconex.crawler.core.ledger.CrawlerEntry

setProcessingOutcome(ProcessingOutcome) - Method in class com.norconex.crawler.core.ledger.CrawlerEntry

setProcessingOutcome(ProcessingOutcome) - Method in class com.norconex.crawler.fs.fetch.impl.GenericFileFetchResponse

setProcessingOutcome(ProcessingOutcome) - Method in class com.norconex.crawler.fs.fetch.impl.GenericFolderPathsFetchResponse

setProcessingOutcome(ProcessingOutcome) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetchResponse

setProcessingStatus(ProcessingStatus) - Method in class com.norconex.crawler.core.ledger.CrawlerEntry

setProperties(Properties) - Method in class com.norconex.committer.sql.SqlCommitterConfig

setProxyDomain(String) - Method in class com.norconex.crawler.fs.fetch.impl.webdav.WebDavFetcherConfig

setProxySettings(ProxySettings) - Method in class com.norconex.committer.azurecognitivesearch.AzureSearchCommitterConfig

Sets the proxy settings.

setProxySettings(ProxySettings) - Method in class com.norconex.committer.amazoncloudsearch.AmazonCloudSearchCommitterConfig

setProxySettings(ProxySettings) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

setProxySettings(ProxySettings) - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcherConfig

Proxy settings used when launching the browser.

setQueryTemplate(String) - Method in class com.norconex.crawler.fs.fetch.impl.cmis.CmisAtomSession

setQueue(CommitterQueue) - Method in class com.norconex.committer.core.batch.BaseBatchCommitterConfig

setQueuedAt(ZonedDateTime) - Method in class com.norconex.crawler.core.ledger.CrawlerEntry

Sets the queued date.

setQueuedListener(Consumer<CrawlerEntry>) - Method in class com.norconex.crawler.core.ledger.CrawlerEntryLedger

Registers a listener that is called each time a new reference is successfully added to the queue.

setQueueStoreEnabled(boolean) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.JdbcHazelcastConfigurer

Whether queue-store persistence should be enabled for Hazelcast queues.

setQuote(Character) - Method in class com.norconex.committer.core.fs.impl.CsvFileCommitterConfig

Quote character to use.

setQuoteCharacter(char) - Method in class com.norconex.importer.handler.splitter.impl.CsvSplitterConfig

The value's surrounding quotes character.

setRealm(String) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthConfig

The realm name for the current authentication scope.

setReasonPhrase(String) - Method in class com.norconex.crawler.fs.fetch.impl.GenericFileFetchResponse

setReasonPhrase(String) - Method in class com.norconex.crawler.fs.fetch.impl.GenericFolderPathsFetchResponse

setReasonPhrase(String) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetchResponse

setRecentDateFormat(String) - Method in class com.norconex.crawler.fs.fetch.impl.ftp.FtpFetcherConfig

setRecrawlableResolver(RecrawlableResolver) - Method in class com.norconex.crawler.web.WebCrawlerConfig

The resolver that indicates whether a given URL is ready to be crawled by a new crawl session.

setRedirectTarget(String) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetchResponse

setRedirectTarget(String) - Method in class com.norconex.crawler.web.ledger.WebCrawlerEntry

setRedirectTrail(List<String>) - Method in class com.norconex.crawler.web.ledger.WebCrawlerEntry

Sets the trail of URLs that were redirected up to this one.

setRedirectUrlProvider(RedirectUrlProvider) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

The redirect URL provider.

setReference(String) - Method in class com.norconex.crawler.fs.ledger.FsCrawlerEntry

setReference(String) - Method in class com.norconex.crawler.core.ledger.CrawlerEntry

setReference(String) - Method in class com.norconex.crawler.web.ledger.WebCrawlerEntry

setReference(String) - Method in class com.norconex.importer.ImporterRequest

setReference(String) - Method in class com.norconex.importer.response.ImporterResponse

setReferenceColumn(String) - Method in class com.norconex.importer.handler.splitter.impl.CsvSplitterConfig

The column containing the unique document reference.

setReferencedUrls(List<String>) - Method in class com.norconex.crawler.web.ledger.WebCrawlerEntry

Sets URLs referenced by this one.

setReferenceFilters(List<ReferenceFilter>) - Method in class com.norconex.crawler.core.CrawlerConfig

Sets reference filters.

setReferenceFilters(List<ReferenceFilter>) - Method in class com.norconex.crawler.core.fetch.BaseFetcherConfig

Sets reference filters.

setReferencePagePrefix(String) - Method in class com.norconex.importer.handler.splitter.impl.PdfPageSplitterConfig

setReferenceTrail(List<String>) - Method in class com.norconex.crawler.core.ledger.CrawlerEntry

Sets original references before normalization, redirect, etc.

setReferrer(String) - Method in class com.norconex.crawler.web.doc.operations.link.Link

setReferrerLinkMetadata(String) - Method in class com.norconex.crawler.web.ledger.WebCrawlerEntry

setReferrerReference(String) - Method in class com.norconex.crawler.web.ledger.WebCrawlerEntry

setRegex(boolean) - Method in class com.norconex.importer.handler.transformer.impl.HierarchyOperation

setRegion(String) - Method in class com.norconex.crawler.fs.fetch.impl.s3.S3FetcherConfig

The AWS region the bucket lives in (e.g.

setRegistrationId(UUID) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.event.CacheEntryChangeListenerAdapter

setRejectCause(Object) - Method in class com.norconex.importer.response.ImporterResponse

setRemoteURL(URL) - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig

URL of a remote WebDriver cluster.

setRemoteVerificationDisabled(boolean) - Method in class com.norconex.crawler.fs.fetch.impl.ftp.FtpFetcherConfig

setRemoveCount(long) - Method in class com.norconex.committer.core.impl.LogCommitter

setReplace(String) - Method in class com.norconex.crawler.web.doc.operations.link.impl.RegexLinkExtractorConfig.ExtractionPattern

setReplacements(List<GenericUrlNormalizerConfig.NormalizationReplace>) - Method in class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizerConfig

setReplicationFactor(short) - Method in class com.norconex.committer.apachekafka.ApacheKafkaCommitterConfig

Gets the replication factor for the new topic.

setRepoId(String) - Method in class com.norconex.crawler.fs.fetch.impl.cmis.CmisAtomSession

setRepoName(String) - Method in class com.norconex.crawler.fs.fetch.impl.cmis.CmisAtomSession

setRepositoryId(String) - Method in class com.norconex.crawler.fs.fetch.impl.cmis.CmisFetcherConfig

The CMIS repository ID.

setRequestHeader(String, String) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

Sets a default HTTP request header every HTTP connection should have.

setRequestHeaders(Map<String, String>) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

Sets a default HTTP request headers every HTTP connection should have.

setRequestHeaders(Map<String, String>) - Method in class com.norconex.crawler.web.fetch.impl.webdriver.HttpSnifferConfig

Sets the request headers to add to every HTTP request.

setRequestIfModifiedSince(HttpRequest, CrawlerDocContext) - Static method in class com.norconex.crawler.web.fetch.util.ApacheHttpUtil

Sets the If-Modified-Since HTTP request header based on document cached last crawled date (if any).

setRequestIfNoneMatch(HttpRequest, CrawlerDocContext) - Static method in class com.norconex.crawler.web.fetch.util.ApacheHttpUtil

Sets the ETag If-None-Match HTTP request header based on document cached ETag value (if any).

setRequestMode(GoogleCloudSearchCommitterConfig.RequestMode) - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig

The priority/consistency mode sent with indexing and delete requests.

setResize(Integer) - Method in class com.norconex.importer.handler.parser.impl.OcrConfig

setResponseProcessors(List<ImporterResponseProcessor>) - Method in class com.norconex.importer.ImporterConfig

setResponseTimeout(Duration) - Method in class com.norconex.crawler.web.fetch.impl.webdriver.HttpSnifferConfig

Maximum wait time for the target host to respond.

setRetryDelay(long) - Method in class com.norconex.committer.core.batch.queue.impl.FsQueueConfig.OnCommitFailure

Delay in milliseconds between retries.

setRobotsMeta(RobotsMeta) - Method in class com.norconex.crawler.web.doc.pipelines.importer.WebImporterPipelineContext

setRobotsMetaProvider(RobotsMetaProvider) - Method in class com.norconex.crawler.web.WebCrawlerConfig

The provider of robots metadata rules for a page (if applicable).

setRobotsTxtProvider(RobotsTxtProvider) - Method in class com.norconex.crawler.web.WebCrawlerConfig

The provider of robots.txt rules for a site (if applicable).

setRobotsTxtSitemapDisabled(boolean) - Method in class com.norconex.crawler.web.doc.operations.sitemap.impl.GenericSitemapLocatorConfig

Whether to disable checking for the sitemap locations in a web site robots.txt file.

setRotation(Double) - Method in class com.norconex.importer.handler.transformer.impl.ImageTransformerConfig

setRunId(String) - Method in class com.norconex.crawler.core.cluster.pipeline.StepRecord

setRunningStep(Step) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.pipeline.PipelineCoordinatorState

setSasToken(String) - Method in class com.norconex.crawler.fs.fetch.impl.adlsgen2.AdlsGen2FetcherConfig

Optional SAS token used instead of shared-key credentials.

setSasToken(String) - Method in class com.norconex.crawler.fs.fetch.impl.azureblob.AzureBlobFetcherConfig

Optional SAS token used instead of shared-key credentials.

setSaveDir(Path) - Method in class com.norconex.importer.handler.transformer.impl.SaveDocumentTransformerConfig

setScaleDimensions(Dimension) - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig

Target pixel size the featured image should be scaled to.

setScaleQuality(FeaturedImageResolverConfig.Quality) - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig

Desired scaling quality.

setScaleStretch(boolean) - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig

Whether to stretch to match scale size.

setSchedules(List<DelaySchedule>) - Method in class com.norconex.crawler.web.doc.operations.delay.impl.GenericDelayResolverConfig

setSchemes(List<String>) - Method in class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractorConfig

Sets the schemes to be extracted.

setSchemes(List<String>) - Method in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractorConfig

Sets the schemes to be extracted.

setScope(BaseDelayResolverConfig.DelayResolverScope) - Method in class com.norconex.crawler.web.doc.operations.delay.impl.BaseDelayResolverConfig

Gets the delay scope.

setScreenshotHandler(PlaywrightScreenshotHandler) - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcherConfig

When configured, takes a screenshot of each fetched page and stores it according to the handler's configuration (document metadata field or local directory).

setScreenshotHandler(WebDriverScreenshotHandler) - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig

When configured, takes screenshots of each web pages.

setScript(String) - Method in class com.norconex.importer.handler.condition.impl.ScriptConditionConfig

setScript(String) - Method in class com.norconex.importer.handler.transformer.impl.ScriptTransformerConfig

setScriptPath(String) - Method in class com.norconex.importer.handler.splitter.impl.TranslatorSplitterConfig

Moses script path.

setScriptRunner(ScriptRunner<Object>) - Method in class com.norconex.importer.handler.transformer.impl.ScriptTransformer

setScriptTimeout(Duration) - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig

Web driver max wait time for a scripts to execute.

setSecretKey(String) - Method in class com.norconex.committer.amazoncloudsearch.AmazonCloudSearchCommitterConfig

The CloudSearch secret key.

setSecretKeyPath(String) - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig

Path to the Google service account JSON key file, with access to the Cloud Search indexing API.

setSecurityMode(SecurityMode) - Method in class com.norconex.crawler.fs.fetch.impl.ftp.FtpFetcherConfig

setSelector(String) - Method in class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractorConfig.LinkSelector

setSelector(String) - Method in class com.norconex.importer.handler.condition.impl.DomConditionConfig

setSelector(String) - Method in class com.norconex.importer.handler.splitter.impl.DomSplitterConfig

The CSS-like selector (see class documentation) identifying which elements to split.

setSelector(String) - Method in class com.norconex.importer.handler.transformer.impl.DomOperation

setSeparator(String) - Method in class com.norconex.crawler.web.doc.operations.filter.impl.SegmentCountUrlFilterConfig

Segment separator.

setSeparator(String) - Method in class com.norconex.importer.handler.transformer.impl.SplitOperation

setSeparatorCharacter(char) - Method in class com.norconex.importer.handler.splitter.impl.CsvSplitterConfig

The value-separator character.

setSeparatorRegex(boolean) - Method in class com.norconex.importer.handler.transformer.impl.SplitOperation

Whether the separator value is a regular expression.

setSerialized(String) - Method in class com.norconex.crawler.core.cluster.SerializedRecord

setServerLanguageCode(String) - Method in class com.norconex.crawler.fs.fetch.impl.ftp.FtpFetcherConfig

setServiceEndpoint(String) - Method in class com.norconex.committer.amazoncloudsearch.AmazonCloudSearchCommitterConfig

The AWS service endpoint.

setServicePrincipalName(String) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.KerberosConfig

The Kerberos service principal name (SPN) for the target service.

setServiceUrl(String) - Method in class com.norconex.importer.handler.parser.impl.GrobidConfig

setShortMonthNames(List<String>) - Method in class com.norconex.crawler.fs.fetch.impl.ftp.FtpFetcherConfig

setShowHeaders(boolean) - Method in class com.norconex.committer.core.fs.impl.CsvFileCommitterConfig

Whether to write column names on the first line.

setSigningRegion(String) - Method in class com.norconex.committer.amazoncloudsearch.AmazonCloudSearchCommitterConfig

The the AWS signing region.

setSingleValue(boolean) - Method in class com.norconex.importer.handler.transformer.impl.MergeOperation

setSingleValueSeparator(String) - Method in class com.norconex.importer.handler.transformer.impl.MergeOperation

setSitemapChangeFreq(String) - Method in class com.norconex.crawler.web.ledger.WebCrawlerEntry

The document change frequency according to sitemap.

setSitemapLastMod(ZonedDateTime) - Method in class com.norconex.crawler.web.ledger.WebCrawlerEntry

The document last modified date according to sitemap.

setSitemapLocator(SitemapLocator) - Method in class com.norconex.crawler.web.WebCrawlerConfig

The locator of sitemaps (if applicable).

setSitemapPriority(Float) - Method in class com.norconex.crawler.web.ledger.WebCrawlerEntry

The document priority according to sitemap.

setSitemapResolver(SitemapResolver) - Method in class com.norconex.crawler.web.WebCrawlerConfig

The resolver of web site sitemaps (if applicable).

setSitemapSupport(GenericRecrawlableResolverConfig.SitemapSupport) - Method in class com.norconex.crawler.web.doc.operations.recrawl.impl.GenericRecrawlableResolverConfig

The sitemap support strategy.

setSkipEmbeddedContentTypes(List<TextMatcher>) - Method in class com.norconex.importer.handler.parser.impl.EmbeddedConfig

Gets the content types of container files to split and treat their embedded files as separate documents.

setSkipEmbeddedOfContentTypes(List<TextMatcher>) - Method in class com.norconex.importer.handler.parser.impl.EmbeddedConfig

Gets the content type matchers of container files you do not want to have their embedded files parsed.

setSkipOcr(Boolean) - Method in class com.norconex.importer.handler.parser.impl.OcrConfig

setSlowMo(Duration) - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcherConfig

Optional slow-motion delay applied between Playwright operations.

setSmtPath(String) - Method in class com.norconex.importer.handler.splitter.impl.TranslatorSplitterConfig

Moses "smtPath".

setSniDisabled(boolean) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

Sets whether Server Name Indication (SNI) is disabled.

setSocketTimeout(Duration) - Method in class com.norconex.committer.elasticsearch.ElasticsearchCommitterConfig

Elasticsearch socket timeout.

setSocketTimeout(Duration) - Method in class com.norconex.crawler.fs.fetch.impl.ftp.FtpFetcherConfig

setSocketTimeout(Duration) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

Gets the maximum period of inactivity between two consecutive data packets.

setSolrClientType(SolrClientType) - Method in class com.norconex.committer.solr.SolrCommitterConfig

The type of Solr client.

setSolrCommitDisabled(boolean) - Method in class com.norconex.committer.solr.SolrCommitterConfig

Whether to send an explicit commit request at the end of every batch, or let the server auto-commit.

setSolrURL(String) - Method in class com.norconex.committer.solr.SolrCommitterConfig

The endpoint URL used to connect to Solr (as per the client type selected).

setSoTimeout(Duration) - Method in class com.norconex.crawler.fs.fetch.impl.webdav.WebDavFetcherConfig

setSourceCharset(Charset) - Method in class com.norconex.importer.handler.condition.impl.DomConditionConfig

The presumed source character encoding.

setSourceCharset(Charset) - Method in class com.norconex.importer.handler.condition.impl.ScriptConditionConfig

The presumed source character encoding.

setSourceCharset(Charset) - Method in class com.norconex.importer.handler.condition.impl.TextConditionConfig

The presumed source character encoding.

setSourceCharset(Charset) - Method in class com.norconex.importer.handler.splitter.impl.DomSplitterConfig

The presumed source character set.

setSourceCharset(Charset) - Method in class com.norconex.importer.handler.transformer.impl.CharsetTransformerConfig

setSourceCharset(Charset) - Method in class com.norconex.importer.handler.transformer.impl.CollapseRepeatingTransformerConfig

setSourceCharset(Charset) - Method in class com.norconex.importer.handler.transformer.impl.CountMatchesTransformerConfig

setSourceCharset(Charset) - Method in class com.norconex.importer.handler.transformer.impl.DomTransformerConfig

The presumed source character set.

setSourceCharset(Charset) - Method in class com.norconex.importer.handler.transformer.impl.LanguageTransformerConfig

setSourceCharset(Charset) - Method in class com.norconex.importer.handler.transformer.impl.RegexTransformerConfig

setSourceCharset(Charset) - Method in class com.norconex.importer.handler.transformer.impl.ReplaceTransformerConfig

setSourceCharset(Charset) - Method in class com.norconex.importer.handler.transformer.impl.ScriptTransformerConfig

setSourceCharset(Charset) - Method in class com.norconex.importer.handler.transformer.impl.StripAfterTransformerConfig

setSourceCharset(Charset) - Method in class com.norconex.importer.handler.transformer.impl.StripBeforeTransformerConfig

setSourceCharset(Charset) - Method in class com.norconex.importer.handler.transformer.impl.StripBetweenTransformerConfig

setSourceCharset(Charset) - Method in class com.norconex.importer.handler.transformer.impl.SubstringTransformerConfig

setSourceCharset(Charset) - Method in class com.norconex.importer.handler.transformer.impl.TextBetweenTransformerConfig

setSourceCharset(Charset) - Method in class com.norconex.importer.handler.transformer.impl.TextStatisticsTransformerConfig

setSourceCharset(Charset) - Method in class com.norconex.importer.handler.transformer.impl.TitleGeneratorTransformerConfig

setSourceCharset(Charset) - Method in class com.norconex.importer.handler.transformer.impl.UrlExtractorTransformerConfig

setSourceContentField(String) - Method in class com.norconex.committer.idol.IdolCommitterConfig

The document field name containing the value to be stored in IDOL DRECONTENT field.

setSourceDeltaExpansion(M365GraphFetcherConfig.SourceDeltaExpansion) - Method in class com.norconex.crawler.fs.fetch.impl.m365graph.M365GraphFetcherConfig

How SOURCE_DELTA start references are expanded into Graph delta roots.

setSourceIdField(String) - Method in class com.norconex.committer.amazoncloudsearch.AmazonCloudSearchCommitterConfig

The document field name containing the value to be stored in CloudSearch "id" field.

setSourceIdField(String) - Method in class com.norconex.committer.elasticsearch.ElasticsearchCommitterConfig

The document field name containing the value to be stored in Elasticsearch "_id" field.

setSourceIdField(String) - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig

Metadata field holding the value to use as the document unique identifier.

setSourceIdField(String) - Method in class com.norconex.committer.solr.SolrCommitterConfig

The document field name containing the value to be stored in Solr ID field.

setSourceKeyField(String) - Method in class com.norconex.committer.azurecognitivesearch.AzureSearchCommitterConfig

The document field name containing the value to be stored in Azure Search document key field.

setSourceLanguage(String) - Method in class com.norconex.importer.handler.splitter.impl.TranslatorSplitterConfig

The original document language.

setSourceLanguageField(String) - Method in class com.norconex.importer.handler.splitter.impl.TranslatorSplitterConfig

The name of a field containing a value representing the original document language.

setSourceReferenceField(String) - Method in class com.norconex.committer.idol.IdolCommitterConfig

The document field name containing the value to be stored in IDOL DREREFERENCE field.

setSplitBatch(FsQueue.SplitBatch) - Method in class com.norconex.committer.core.batch.queue.impl.FsQueueConfig.OnCommitFailure

Whether and how to split batches when re-attempting them when they fail See class documentation for details.

setSplitContentTypes(List<TextMatcher>) - Method in class com.norconex.importer.handler.parser.impl.EmbeddedConfig

Gets the content types of container files to split and treat their embedded files as separate documents.

setSplitUpsertDelete(boolean) - Method in class com.norconex.committer.core.fs.BaseFsCommitterConfig

setSpoiledReferenceStrategizer(SpoiledReferenceStrategizer) - Method in class com.norconex.crawler.core.CrawlerConfig

The spoiled state strategy resolver.

setSqlMerge(String) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.JdbcHazelcastConfigurer

SQL merge/upsert template used for map stores.

setSslProtocols(List<String>) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

Sets the supported SSL/TLS protocols, such as SSLv3, TLSv1, TLSv1.1, and TLSv1.2.

setStart(T) - Method in class com.norconex.crawler.web.doc.operations.delay.impl.DelayRange

setStartMatcher(TextMatcher) - Method in class com.norconex.importer.handler.transformer.impl.StripBetweenOperation

Sets the start delimiter matcher for text to strip.

setStartMatcher(TextMatcher) - Method in class com.norconex.importer.handler.transformer.impl.TextBetweenOperation

Sets the start delimiter matcher for text to extract.

setStartReferences(List<String>) - Method in class com.norconex.crawler.core.CrawlerConfig

Sets the references to initiate crawling from.

setStartReferencesAsync(boolean) - Method in class com.norconex.crawler.core.CrawlerConfig

Whether the start references should be loaded asynchronously.

setStartReferencesFiles(List<Path>) - Method in class com.norconex.crawler.core.CrawlerConfig

Sets the file paths of seed files containing references to be used as start references.

setStartReferencesProviders(List<ReferencesProvider>) - Method in class com.norconex.crawler.core.CrawlerConfig

Sets the providers of references used as starting points for crawling.

setStartReferencesSitemaps(List<String>) - Method in class com.norconex.crawler.web.WebCrawlerConfig

Sets the sitemap URLs used as starting points for crawling.

setStartRefsQueueingComplete(boolean) - Method in class com.norconex.crawler.core.session.CrawlerSession

setStartRefsQueueingComplete(boolean) - Method in class com.norconex.crawler.core.session.CrawlerStateStore

Marks whether start-reference queuing has completed.

setStatus(PipelineStatus) - Method in class com.norconex.crawler.core.cluster.pipeline.StepRecord

setStatus(ImporterResponse.Status) - Method in class com.norconex.importer.response.ImporterResponse

setStatusCode(int) - Method in class com.norconex.crawler.fs.fetch.impl.GenericFileFetchResponse

setStatusCode(int) - Method in class com.norconex.crawler.fs.fetch.impl.GenericFolderPathsFetchResponse

setStatusCode(int) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetchResponse

setStatusCodes(String) - Method in class com.norconex.crawler.web.event.listeners.UrlStatusCrawlerEventListenerConfig

The coma-separated list of status codes to listen to.

setStayOnDomain(boolean) - Method in class com.norconex.crawler.web.doc.operations.scope.impl.GenericUrlScopeResolverConfig

Whether the crawler should always stay on the same domain name as the domain for each URL specified as a start URL.

setStayOnPort(boolean) - Method in class com.norconex.crawler.web.doc.operations.scope.impl.GenericUrlScopeResolverConfig

Whether the crawler should always stay on the same port as the port for each URL specified as a start URL.

setStayOnProtocol(boolean) - Method in class com.norconex.crawler.web.doc.operations.scope.impl.GenericUrlScopeResolverConfig

Whether the crawler should always stay on the same protocol as the protocol for each URL specified as a start URL.

setStayOnSitemap(boolean) - Method in class com.norconex.crawler.web.doc.operations.scope.impl.GenericUrlScopeResolverConfig

Whether to limit crawling to entries found in an existing website sitemap (do not go deeper).

setStepId(String) - Method in class com.norconex.crawler.core.cluster.pipeline.StepRecord

setStopCheckCallback(Runnable) - Method in class com.norconex.crawler.core.cmd.crawl.CrawlerProgressLogger

setStopOnExceptions(List<Class<? extends Exception>>) - Method in class com.norconex.crawler.core.CrawlerConfig

Sets the exceptions we want to stop the crawler on.

setStorageDiskDir(Path) - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig

Path to directory where to store images on disk.

setStorageDiskField(String) - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig

Name of metadata field where to store the local path to an image.

setStorageDiskStructure(FeaturedImageResolverConfig.StorageDiskStructure) - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig

The type of directory structure to create when one of the values of of FeaturedImageResolverConfig.getStorages() is FeaturedImageResolverConfig.Storage.DISK.

setStorageInlineField(String) - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig

Name of metadata field where to store the Base64 image.

setStorages(List<FeaturedImageResolverConfig.Storage>) - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig

Sets the storages mechanisms.

setStorageUrlField(String) - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig

Name of metadata field where to store the remote image URL.

setStreamFactory(CachedStreamFactory) - Method in class com.norconex.committer.core.CommitterContext.Builder

setStretch(boolean) - Method in class com.norconex.importer.handler.transformer.impl.ImageTransformerConfig.Scale

setStrictHostKeyChecking(String) - Method in class com.norconex.crawler.fs.fetch.impl.sftp.SftpFetcherConfig

setString(String, String) - Method in class com.norconex.crawler.core.session.CrawlerAttributes

Sets an attribute as a string.

setStringIfAbsent(String, String) - Method in class com.norconex.crawler.core.session.CrawlerAttributes

Atomically sets an attribute as a string if it is not already set.

setStrings(List<String>) - Method in class com.norconex.importer.handler.transformer.impl.CollapseRepeatingTransformerConfig

setStripAfterMatcher(TextMatcher) - Method in class com.norconex.importer.handler.transformer.impl.StripAfterTransformerConfig

Sets the matcher of text after which to strip.

setStripBeforeMatcher(TextMatcher) - Method in class com.norconex.importer.handler.transformer.impl.StripBeforeTransformerConfig

Sets the matcher for the text up to which to strip content.

setStructuredDataMappings(List<GoogleCloudSearchCommitterConfig.StructuredDataMapping>) - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig

setSuffix(String) - Method in class com.norconex.importer.handler.transformer.impl.TruncateTransformerConfig

setTableName(String) - Method in class com.norconex.committer.sql.SqlCommitterConfig

The target database table name where documents will be committed.

setTarget(GoogleCloudSearchCommitterConfig.AclTarget) - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.AclMapping

Which ACL list the resolved principal(s) are added to.

setTargetCharset(Charset) - Method in class com.norconex.importer.handler.transformer.impl.CharsetTransformerConfig

setTargetContentField(String) - Method in class com.norconex.committer.amazoncloudsearch.AmazonCloudSearchCommitterConfig

The name of the CloudSearch field where content will be stored.

setTargetContentField(String) - Method in class com.norconex.committer.azurecognitivesearch.AzureSearchCommitterConfig

The name of the Azure Search field where content will be stored.

setTargetContentField(String) - Method in class com.norconex.committer.elasticsearch.ElasticsearchCommitterConfig

The name of the Elasticsearch field where content will be stored.

setTargetContentField(String) - Method in class com.norconex.committer.solr.SolrCommitterConfig

The name of the Solr field where content will be stored.

setTargetContentField(String) - Method in class com.norconex.committer.sql.SqlCommitterConfig

Table field name where to store the document content stream.

setTargetDir(Path) - Method in class com.norconex.crawler.web.fetch.util.DocImageHandlerConfig

setTargetDirField(String) - Method in class com.norconex.crawler.web.fetch.util.DocImageHandlerConfig

setTargetDirStructure(DocImageHandlerConfig.DirStructure) - Method in class com.norconex.crawler.web.fetch.util.DocImageHandlerConfig

setTargetFormat(String) - Method in class com.norconex.importer.handler.transformer.impl.ImageTransformerConfig

setTargetIdField(String) - Method in class com.norconex.committer.solr.SolrCommitterConfig

The name of the Solr field where to store a document unique identifier (sourceIdField).

setTargetKeyField(String) - Method in class com.norconex.committer.azurecognitivesearch.AzureSearchCommitterConfig

The name of Azure Search key field where to store a document unique identifier (sourceKeyField).

setTargetLanguages(List<String>) - Method in class com.norconex.importer.handler.splitter.impl.TranslatorSplitterConfig

setTargetMetaField(String) - Method in class com.norconex.crawler.web.fetch.util.DocImageHandlerConfig

setTargets(List<DocImageHandlerConfig.Target>) - Method in class com.norconex.crawler.web.fetch.util.DocImageHandlerConfig

setTcpMembers(String) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.JdbcHazelcastConfigurer

TCP/IP member list for clustered discovery, as a comma-separated list of host:port addresses (e.g., "192.168.1.10:5701,192.168.1.11:5701").

setTempDir(Path) - Method in class com.norconex.importer.handler.transformer.impl.ExternalTransformerConfig

The directory where to store temporary files sent to the external handler as file paths.

setTempDir(Path) - Method in class com.norconex.importer.ImporterConfig

The temporary directory where files can be deleted safely by the OS or any other processes when the Importer is not running.

setTenantId(String) - Method in class com.norconex.crawler.fs.fetch.impl.m365graph.M365GraphFetcherConfig

Tenant ID used to acquire an access token.

setTessdataPath(Path) - Method in class com.norconex.importer.handler.parser.impl.OcrConfig

setTesseractPath(Path) - Method in class com.norconex.importer.handler.parser.impl.OcrConfig

setThenHandlers(List<DocHandler>) - Method in class com.norconex.importer.handler.condition.ConditionalDocHandler

setThreadWait(Duration) - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig

Makes the current thread sleep for the specified duration, to give the web driver enough time to load the page.

setTikaConfigFile(String) - Method in class com.norconex.importer.handler.parser.impl.TikaParserConfig

The path to a Tika configuration file.

setTimeoutSeconds(Integer) - Method in class com.norconex.importer.handler.parser.impl.OcrConfig

setTimeRange(DelayRange<LocalTime>) - Method in class com.norconex.crawler.web.doc.operations.delay.impl.DelaySchedule

setTimestamped(boolean) - Method in class com.norconex.crawler.web.event.listeners.UrlStatusCrawlerEventListenerConfig

Whether to add a timestamp to the file name, to ensure a new one is created with each run.

setTitleMaxLength(int) - Method in class com.norconex.importer.handler.transformer.impl.TitleGeneratorTransformerConfig

setTlsVersions(String) - Method in class com.norconex.crawler.fs.fetch.impl.webdav.WebDavFetcherConfig

setToField(MetadataField) - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.MetadataMapping

Mandatory target Google Cloud Search metadata field.

setToField(String) - Method in class com.norconex.crawler.core.doc.operations.checksum.BaseChecksummerConfig

The metadata field to use to store the checksum value.

setToField(String) - Method in class com.norconex.importer.handler.transformer.impl.CountMatchesTransformerConfig

The target field.

setToField(String) - Method in class com.norconex.importer.handler.transformer.impl.CurrentDateTransformerConfig

The target field.

setToField(String) - Method in class com.norconex.importer.handler.transformer.impl.DateFormatTransformerConfig

setToField(String) - Method in class com.norconex.importer.handler.transformer.impl.DocumentLengthTransformerConfig

Gets the target field.

setToField(String) - Method in class com.norconex.importer.handler.transformer.impl.DomOperation

The target field for extracted content.

setToField(String) - Method in class com.norconex.importer.handler.transformer.impl.HierarchyOperation

setToField(String) - Method in class com.norconex.importer.handler.transformer.impl.MergeOperation

setToField(String) - Method in class com.norconex.importer.handler.transformer.impl.RenameOperation

setToField(String) - Method in class com.norconex.importer.handler.transformer.impl.ReplaceOperation

setToField(String) - Method in class com.norconex.importer.handler.transformer.impl.SplitOperation

setToField(String) - Method in class com.norconex.importer.handler.transformer.impl.TextBetweenOperation

The target field for extracted text.

setToField(String) - Method in class com.norconex.importer.handler.transformer.impl.TitleGeneratorTransformerConfig

setToField(String) - Method in class com.norconex.importer.handler.transformer.impl.TruncateTransformerConfig

setToField(String) - Method in class com.norconex.importer.handler.transformer.impl.UrlExtractorTransformerConfig

setToField(String) - Method in class com.norconex.importer.handler.transformer.impl.UuidTransformerConfig

The target field.

setToFormat(String) - Method in class com.norconex.importer.handler.transformer.impl.DateFormatTransformerConfig

setToLocale(Locale) - Method in class com.norconex.importer.handler.transformer.impl.DateFormatTransformerConfig

The locale used for formatting the target date.

setTopicName(String) - Method in class com.norconex.committer.apachekafka.ApacheKafkaCommitterConfig

The topic name to which documents will be sent

setToSeparator(String) - Method in class com.norconex.importer.handler.transformer.impl.HierarchyOperation

setToValue(String) - Method in class com.norconex.importer.handler.transformer.impl.ReplaceOperation

setTruncateAt(int) - Method in class com.norconex.committer.core.fs.impl.CsvColumn

setTruncateAt(int) - Method in class com.norconex.committer.core.fs.impl.CsvFileCommitterConfig

Number of characters from which long text will be truncated.

setTruncateSamplesAt(int) - Method in class com.norconex.importer.handler.transformer.impl.FieldReportTransformerConfig

setTrustAllSSLCertificates(boolean) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

Sets whether to trust all SSL certificate (affects only "https" connections).

setType(GoogleCloudSearchCommitterConfig.StructuredDataType) - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.StructuredDataMapping

Value type to use for this field.

setTypeHeader(String) - Method in class com.norconex.committer.core.fs.impl.CsvFileCommitterConfig

When generating CSV files containing both upserts and deletes requests, what column name to use to display the request type.

setTypeName(String) - Method in class com.norconex.committer.elasticsearch.ElasticsearchCommitterConfig

The type name.

setUpdatedAt(long) - Method in class com.norconex.crawler.core.cluster.pipeline.StepRecord

setUpdateUrlParam(String, String) - Method in class com.norconex.committer.solr.SolrCommitterConfig

Sets a URL parameter to be added on Solr HTTP calls.

setUpdateUrlParams(Map<String, String>) - Method in class com.norconex.committer.solr.SolrCommitterConfig

Sets URL parameters to be added on Solr HTTP calls.

setUploadFormat(GoogleCloudSearchCommitterConfig.UploadFormat) - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig

The format used to upload document content.

setUpsertCypher(String) - Method in class com.norconex.committer.neo4j.Neo4jCommitterConfig

Cypher query for adding relationships to Neo4j.

setUri(String) - Method in class com.norconex.committer.neo4j.Neo4jCommitterConfig

Required connection URI.

setUrl(String) - Method in class com.norconex.committer.idol.IdolCommitterConfig

The IDOL/DIH/CFS index action URL.

setUrl(String) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthConfig

The URL for "form" authentication.

setUrlCharset(String) - Method in class com.norconex.crawler.fs.fetch.impl.webdav.WebDavFetcherConfig

setUrlNormalizers(List<WebUrlNormalizer>) - Method in class com.norconex.crawler.web.WebCrawlerConfig

Sets URL normalizers.

setUrlRoot(String) - Method in class com.norconex.crawler.web.ledger.WebCrawlerEntry

setUrlScopeResolver(UrlScopeResolver) - Method in class com.norconex.crawler.web.WebCrawlerConfig

The strategy to use to determine if a URL is in scope.

setUseFirstRowAsFields(boolean) - Method in class com.norconex.importer.handler.splitter.impl.CsvSplitterConfig

Whether to use the first row as field names for values.

setUseHtmlUnit(boolean) - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig

Experimental feature where the selected WebDriverBrowser will be used to configure and use HtmlUnit WebDriver as a wrapper instead of directly using the browser WebDriver.

setUserAgent(String) - Method in class com.norconex.crawler.fs.fetch.impl.webdav.WebDavFetcherConfig

setUserAgent(String) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

The user-agent used when identifying the crawler to targeted web sites.

setUserAgent(String) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetchResponse

setUserAgent(String) - Method in class com.norconex.crawler.web.fetch.impl.webdriver.HttpSnifferConfig

Optionally overwrite browser user agent.

setUserDirIsRoot(boolean) - Method in class com.norconex.crawler.fs.fetch.impl.ftp.FtpFetcherConfig

setUserDirIsRoot(boolean) - Method in class com.norconex.crawler.fs.fetch.impl.sftp.SftpFetcherConfig

setUserKey(String) - Method in class com.norconex.importer.handler.splitter.impl.TranslatorSplitterConfig

Lingo24 user key.

setUseTicketCache(boolean) - Method in class com.norconex.crawler.fs.fetch.impl.hdfs.KerberosConfig

Whether to use the system ticket cache for authentication.

setUseTicketCache(boolean) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.KerberosConfig

Whether to use the system ticket cache for authentication.

setUseWindowsAuth(boolean) - Method in class com.norconex.committer.azurecognitivesearch.AzureSearchCommitterConfig

Whether to use integrated Windows Authentication (if applicable).

setValidStatusCodes(List<Integer>) - Method in class com.norconex.crawler.fs.fetch.impl.box.BoxFetcherConfig

setValidStatusCodes(List<Integer>) - Method in class com.norconex.crawler.fs.fetch.impl.egnyte.EgnyteFetcherConfig

setValidStatusCodes(List<Integer>) - Method in class com.norconex.crawler.fs.fetch.impl.m365graph.M365GraphFetcherConfig

setValidStatusCodes(List<Integer>) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

Gets valid HTTP response status codes.

setValue(String) - Method in class com.norconex.crawler.web.doc.operations.recrawl.impl.GenericRecrawlableResolverConfig.MinFrequency

String representation of a frequency.

setValueClass(Class<?>) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.jdbc.TypedJdbcMapStoreFactory

setValueClass(Class<?>) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.jdbc.TypedJdbcQueueStoreFactory

setValueClass(Class<?>) - Method in interface com.norconex.crawler.core.cluster.impl.hazelcast.LazyTypedStoreFactory

setValueMatcher(TextMatcher) - Method in class com.norconex.crawler.core.doc.operations.filter.impl.GenericMetadataFilterConfig

Sets the value matcher.

setValueMatcher(TextMatcher) - Method in class com.norconex.crawler.core.doc.operations.filter.impl.GenericReferenceFilterConfig

Sets the value matcher.

setValueMatcher(TextMatcher) - Method in class com.norconex.importer.handler.condition.impl.DomConditionConfig

Sets this condition value matcher.

setValueMatcher(TextMatcher) - Method in class com.norconex.importer.handler.condition.impl.ReferenceConditionConfig

Sets the text matcher for field values.

setValueMatcher(TextMatcher) - Method in class com.norconex.importer.handler.condition.impl.TextConditionConfig

Sets the text matcher for content or field values.

setValueMatcher(TextMatcher) - Method in class com.norconex.importer.handler.transformer.impl.ReplaceOperation

Sets value matcher.

setValueMatcher(DateValueMatcher) - Method in class com.norconex.importer.handler.condition.impl.DateConditionConfig

setValueMatcher(NumericValueMatcher) - Method in class com.norconex.importer.handler.condition.impl.NumericConditionConfig

setValueMatcherRangeEnd(DateValueMatcher) - Method in class com.norconex.importer.handler.condition.impl.DateConditionConfig

setValueMatcherRangeEnd(NumericValueMatcher) - Method in class com.norconex.importer.handler.condition.impl.NumericConditionConfig

setVariablesFile(Path) - Method in class com.norconex.crawler.core.cli.CliBase

setWaitForElementSelector(String) - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcherConfig

Selector expression used to wait for a specific element to appear in the page before returning.

setWaitForElementSelector(String) - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig

Reference to an element to wait for.

setWaitForElementTimeout(Duration) - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcherConfig

Maximum time to wait for the element identified by PlaywrightFetcherConfig.getWaitForElementSelector() to appear.

setWaitForElementTimeout(Duration) - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig

Max wait time for an element to show up in browser before returning.

setWaitForElementType(PlaywrightFetcherConfig.WaitElementType) - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcherConfig

The type of reference used when waiting for an element to appear.

setWaitForElementType(WebDriverFetcherConfig.WaitElementType) - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig

The type of reference to use when waiting for an element.

setWidth(Integer) - Method in class com.norconex.importer.handler.transformer.impl.ImageTransformerConfig.Crop

setWidth(Integer) - Method in class com.norconex.importer.handler.transformer.impl.ImageTransformerConfig.Scale

setWindowSize(Dimension) - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcherConfig

Optional browser viewport size.

setWindowSize(Dimension) - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig

Optionally set the browser window dimensions.

setWithHeaders(boolean) - Method in class com.norconex.importer.handler.transformer.impl.FieldReportTransformerConfig

setWithOccurences(boolean) - Method in class com.norconex.importer.handler.transformer.impl.FieldReportTransformerConfig

setWorkDir(Path) - Method in class com.norconex.committer.core.CommitterContext.Builder

setWorkDir(Path) - Method in class com.norconex.crawler.core.CrawlerConfig

The base directory location where files generated during execution will reside.

setWorkerHeartbeatInterval(Duration) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastClusterConnectorConfig

Interval at which worker nodes send heartbeat updates for their current pipeline status to the coordinator.

setWorkstation(String) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthConfig

The NTLM authentication workstation name.

setWriteBatchSize(int) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.JdbcHazelcastConfigurer

Maximum number of entries per write-behind batch.

setWriteCoalescing(boolean) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.JdbcHazelcastConfigurer

Whether to coalesce write-behind updates so that only the latest value for each key is persisted per batch.

setWriteDelaySeconds(int) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.JdbcHazelcastConfigurer

Write-behind delay in seconds for data maps (ledger, session, etc.).

setX(int) - Method in class com.norconex.importer.handler.transformer.impl.ImageTransformerConfig.Crop

setXmlTargetField(String) - Method in class com.norconex.crawler.fs.fetch.impl.cmis.CmisFetcherConfig

The name of the field where the raw XML obtained from the CMIS REST API will be stored.

setY(int) - Method in class com.norconex.importer.handler.transformer.impl.ImageTransformerConfig.Crop

SftpFetcher - Class in com.norconex.crawler.fs.fetch.impl.sftp

SFTP fetcher (sftp://), backed by the sftp-fs NIO.2 file system provider.

SftpFetcher() - Constructor for class com.norconex.crawler.fs.fetch.impl.sftp.SftpFetcher

SftpFetcherConfig - Class in com.norconex.crawler.fs.fetch.impl.sftp

Configuration for SftpFetcher.

SftpFetcherConfig() - Constructor for class com.norconex.crawler.fs.fetch.impl.sftp.SftpFetcherConfig

shouldContinueOnBadStatus(CrawlerContext, ProcessingOutcome, FetchDirective) - Static method in class com.norconex.crawler.core.fetch.FetchUtil

Should I use this transformer? - Search tag in class com.norconex.importer.handler.transformer.impl.CharsetTransformer

Section

Should I use this transformer? - Search tag in class com.norconex.importer.handler.transformer.impl.CharsetTransformerConfig

Section

showHeaders - Static variable in class com.norconex.committer.core.fs.impl.CsvFileCommitterConfig.Fields

shutdown() - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverManager

shutdownAndAwait(ExecutorService, Duration) - Static method in class com.norconex.crawler.core.util.ConcurrentUtil

Shuts down an executor and await for confirmation up to the specified duration, after which a force shutdown is attempted.

SIMPLE - Enum constant in enum class com.norconex.crawler.fs.fetch.impl.hdfs.HdfsAuthMethod

No real authentication: the configured username, if any, is sent as the user.name query parameter.

Single date vs range of dates: - Search tag in class com.norconex.importer.handler.condition.impl.DateCondition

Section

Single date vs range of dates: - Search tag in class com.norconex.importer.handler.condition.impl.DateConditionConfig

Section

Single number vs range of numbers: - Search tag in class com.norconex.importer.handler.condition.impl.NumericCondition

Section

Single number vs range of numbers: - Search tag in class com.norconex.importer.handler.condition.impl.NumericConditionConfig

Section

Single vs multiple values - Search tag in class com.norconex.committer.azurecognitivesearch.AzureSearchCommitter

Section

SITE - Enum constant in enum class com.norconex.crawler.web.doc.operations.delay.impl.BaseDelayResolverConfig.DelayResolverScope

SiteDelay - Class in com.norconex.crawler.web.doc.operations.delay.impl

SiteDelay() - Constructor for class com.norconex.crawler.web.doc.operations.delay.impl.SiteDelay

SITEMAP_RESOLVE_BEGIN - Static variable in class com.norconex.crawler.web.event.WebCrawlerEvent

SITEMAP_RESOLVE_END - Static variable in class com.norconex.crawler.web.event.WebCrawlerEvent

SitemapChangeFrequency - Enum Class in com.norconex.crawler.web.doc.operations.sitemap

Sitemap change frequency unit, as defined on http://www.sitemaps.org/protocol.html

SitemapContext - Class in com.norconex.crawler.web.doc.operations.sitemap

SitemapContext.SitemapContextBuilder - Class in com.norconex.crawler.web.doc.operations.sitemap

SitemapEnqueuer - Class in com.norconex.crawler.web.doc.pipelines.queue

SitemapEnqueuer() - Constructor for class com.norconex.crawler.web.doc.pipelines.queue.SitemapEnqueuer

sitemapLocation(String) - Method in class com.norconex.crawler.web.doc.operations.robot.RobotsTxt.RobotsTxtBuilder

sitemapLocations(Collection<? extends String>) - Method in class com.norconex.crawler.web.doc.operations.robot.RobotsTxt.RobotsTxtBuilder

sitemapLocator - Static variable in class com.norconex.crawler.web.WebCrawlerConfig.Fields

SitemapLocator - Interface in com.norconex.crawler.web.doc.operations.sitemap

Suggestions of sitemap locations associated with a URL web site.

SitemapRecord - Class in com.norconex.crawler.web.doc.operations.sitemap

SitemapRecord() - Constructor for class com.norconex.crawler.web.doc.operations.sitemap.SitemapRecord

SitemapResolutionStage - Class in com.norconex.crawler.web.doc.pipelines.queue.stages

SitemapResolutionStage() - Constructor for class com.norconex.crawler.web.doc.pipelines.queue.stages.SitemapResolutionStage

sitemapResolver - Static variable in class com.norconex.crawler.web.WebCrawlerConfig.Fields

SitemapResolver - Interface in com.norconex.crawler.web.doc.operations.sitemap

Sitemap support: - Search tag in class com.norconex.crawler.web.doc.operations.recrawl.impl.GenericRecrawlableResolver

Section

size() - Method in interface com.norconex.crawler.core.cluster.CacheMap

Counts the number of entries in this cache.

size() - Method in interface com.norconex.crawler.core.cluster.CacheQueue

size() - Method in interface com.norconex.crawler.core.cluster.CacheSet

size() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastMapAdapter

size() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastQueueAdapter

size() - Method in class com.norconex.crawler.core.cluster.impl.memory.InMemoryCacheMap

size() - Method in class com.norconex.crawler.core.cluster.impl.memory.InMemoryCacheQueue

size() - Method in class com.norconex.crawler.core.cluster.impl.memory.InMemoryCacheSet

size() - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheMap

size() - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheQueue

size() - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheSet

size() - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyFileAttributes

skipEmpty() - Method in class com.norconex.importer.util.ReadAdapter.ChunkedReadOptions

skipEmpty(boolean) - Method in class com.norconex.importer.util.chunk.ChunkedTextReader.ChunkedTextReaderBuilder

skipEmpty(boolean) - Method in class com.norconex.importer.util.ReadAdapter.ChunkedReadOptions

skipOcr - Static variable in class com.norconex.importer.handler.parser.impl.OcrConfig.Fields

SM_CHANGE_FREQ - Static variable in class com.norconex.crawler.web.doc.WebDocMetadata

SM_LASTMOD - Static variable in class com.norconex.crawler.web.doc.WebDocMetadata

SM_PRORITY - Static variable in class com.norconex.crawler.web.doc.WebDocMetadata

SmbFetcher - Class in com.norconex.crawler.fs.fetch.impl.smb

CIFS fetcher (Samba, Windows share) (smb://), backed by a custom, read-only NIO.2 FileSystemProvider (SmbFileSystemProvider) built directly on jcifs-ng's classic SmbFile API.

SmbFetcher() - Constructor for class com.norconex.crawler.fs.fetch.impl.smb.SmbFetcher

SmbFetcherConfig - Class in com.norconex.crawler.fs.fetch.impl.smb

Configuration for SmbFetcher.

SmbFetcherConfig() - Constructor for class com.norconex.crawler.fs.fetch.impl.smb.SmbFetcherConfig

Solr Client: - Search tag in class com.norconex.committer.solr.SolrCommitter

Section

SolrClientType - Enum Class in com.norconex.committer.solr

Supported SolrClient types.

SolrCommitter - Class in com.norconex.committer.solr

Commits documents to Apache Solr.

SolrCommitter() - Constructor for class com.norconex.committer.solr.SolrCommitter

SolrCommitterConfig - Class in com.norconex.committer.solr

Configuration for SolrCommitter.

SolrCommitterConfig() - Constructor for class com.norconex.committer.solr.SolrCommitterConfig

SolrCommitterPtProvider - Class in com.norconex.committer.solr.spi

For auto registering in BeanMapper.

SolrCommitterPtProvider() - Constructor for class com.norconex.committer.solr.spi.SolrCommitterPtProvider

SORT_QUERY_PARAMETERS - Enum constant in enum class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizerConfig.Normalization

SOURCE_DELTA - Enum constant in enum class com.norconex.crawler.core.CrawlerConfig.ChangeDiscovery

The source provides explicit change/delete signals (delta feed).

SOURCE_REPOSITORY_URL - Enum constant in enum class com.norconex.committer.googlecloudsearch.MetadataField

split(DocHandlerContext) - Method in class com.norconex.importer.handler.splitter.AbstractDocumentSplitter

split(DocHandlerContext) - Method in class com.norconex.importer.handler.splitter.impl.CsvSplitter

split(DocHandlerContext) - Method in class com.norconex.importer.handler.splitter.impl.DomSplitter

split(DocHandlerContext) - Method in class com.norconex.importer.handler.splitter.impl.PdfPageSplitter

split(DocHandlerContext) - Method in class com.norconex.importer.handler.splitter.impl.TranslatorSplitter

split(DocHandlerContext) - Method in class com.norconex.importer.handler.splitter.impl.XmlStreamSplitter

SplitOperation - Class in com.norconex.importer.handler.transformer.impl

SplitOperation() - Constructor for class com.norconex.importer.handler.transformer.impl.SplitOperation

SplitTransformer - Class in com.norconex.importer.handler.transformer.impl

Splits an existing metadata value into multiple values based on a given value separator (the separator gets discarded).

SplitTransformer() - Constructor for class com.norconex.importer.handler.transformer.impl.SplitTransformer

SplitTransformerConfig - Class in com.norconex.importer.handler.transformer.impl

Splits an existing metadata value into multiple values based on a given value separator (the separator gets discarded).

SplitTransformerConfig() - Constructor for class com.norconex.importer.handler.transformer.impl.SplitTransformerConfig

SPNEGO - Enum constant in enum class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthMethod

SPNEGO authentication method.

spoiledReferenceStrategizer - Static variable in class com.norconex.crawler.core.CrawlerConfig.Fields

SpoiledReferenceStrategizer - Interface in com.norconex.crawler.core.doc.operations.spoil

Decides which strategy to adopt for a given reference with a bad state.

SpoiledReferenceStrategy - Enum Class in com.norconex.crawler.core.doc.operations.spoil

Markers indicating what to do with references that were once processed properly, but failed to get a good processing state a subsequent time around.

SqlCommitter - Class in com.norconex.committer.sql

Commit documents to an SQL table.

SqlCommitter() - Constructor for class com.norconex.committer.sql.SqlCommitter

SqlCommitterConfig - Class in com.norconex.committer.sql

SQL Committer configuration.

SqlCommitterConfig() - Constructor for class com.norconex.committer.sql.SqlCommitterConfig

SqlCommitterPtProvider - Class in com.norconex.committer.sql.spi

For auto registering in BeanMapper.

SqlCommitterPtProvider() - Constructor for class com.norconex.committer.sql.spi.SqlCommitterPtProvider

stage(Predicate<CommitterPipelineContext>) - Method in class com.norconex.crawler.core.doc.pipelines.committer.CommitterPipeline.CommitterPipelineBuilder

stage(Predicate<ImporterPipelineContext>) - Method in class com.norconex.crawler.core.doc.pipelines.importer.ImporterPipeline.ImporterPipelineBuilder

stage(Predicate<QueuePipelineContext>) - Method in class com.norconex.crawler.core.doc.pipelines.queue.QueuePipeline.QueuePipelineBuilder

stages(Collection<? extends Predicate<CommitterPipelineContext>>) - Method in class com.norconex.crawler.core.doc.pipelines.committer.CommitterPipeline.CommitterPipelineBuilder

stages(Collection<? extends Predicate<ImporterPipelineContext>>) - Method in class com.norconex.crawler.core.doc.pipelines.importer.ImporterPipeline.ImporterPipelineBuilder

stages(Collection<? extends Predicate<QueuePipelineContext>>) - Method in class com.norconex.crawler.core.doc.pipelines.queue.QueuePipeline.QueuePipelineBuilder

StandardRobotsMetaProvider - Class in com.norconex.crawler.web.doc.operations.robot.impl

Implementation of RobotsMetaProvider as per X-Robots-Tag and ROBOTS standards.

StandardRobotsMetaProvider() - Constructor for class com.norconex.crawler.web.doc.operations.robot.impl.StandardRobotsMetaProvider

StandardRobotsMetaProviderConfig - Class in com.norconex.crawler.web.doc.operations.robot.impl

Configuration for StandardRobotsMetaProvider.

StandardRobotsMetaProviderConfig() - Constructor for class com.norconex.crawler.web.doc.operations.robot.impl.StandardRobotsMetaProviderConfig

StandardRobotsTxtProvider - Class in com.norconex.crawler.web.doc.operations.robot.impl

Implementation of RobotsTxtProvider as per the robots.txt standard described at http://www.robotstxt.org/robotstxt.html.

StandardRobotsTxtProvider() - Constructor for class com.norconex.crawler.web.doc.operations.robot.impl.StandardRobotsTxtProvider

start - Static variable in class com.norconex.crawler.web.doc.operations.delay.impl.DelayRange.Fields

start() - Method in class com.norconex.crawler.core.cluster.admin.ClusterAdminServer

Starts the HTTP server on an available port starting from 27295.

start() - Method in class com.norconex.crawler.core.cmd.crawl.CrawlerProgressLogger

start() - Method in class com.norconex.crawler.web.fetch.impl.webdriver.HttpSniffer

startedAt(long) - Method in class com.norconex.crawler.core.cluster.pipeline.PipelineResult.PipelineResultBuilder

startReferences - Static variable in class com.norconex.crawler.core.CrawlerConfig.Fields

startReferencesAsync - Static variable in class com.norconex.crawler.core.CrawlerConfig.Fields

startReferencesFiles - Static variable in class com.norconex.crawler.core.CrawlerConfig.Fields

startReferencesProviders - Static variable in class com.norconex.crawler.core.CrawlerConfig.Fields

startReferencesSitemaps - Static variable in class com.norconex.crawler.web.WebCrawlerConfig.Fields

StartRefsQueueStep - Class in com.norconex.crawler.core.cmd.crawl.pipeline.bootstrap.queue

StartRefsQueueStep(String) - Constructor for class com.norconex.crawler.core.cmd.crawl.pipeline.bootstrap.queue.StartRefsQueueStep

startStopMonitoring() - Method in interface com.norconex.crawler.core.cluster.Cluster

Starts monitoring for stop signals.

startStopMonitoring() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastCluster

startStopMonitoring() - Method in class com.norconex.crawler.core.cluster.impl.memory.MemoryCluster

startStopMonitoring() - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCluster

startsWith(String) - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyPath

startsWith(Path) - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyPath

Start URLs - Search tag in class com.norconex.crawler.web.WebCrawlerConfig

Section

State() - Constructor for class com.norconex.crawler.core.session.CrawlerSession.State

Static dates: - Search tag in class com.norconex.importer.handler.condition.impl.DateProviderFactory

Section

StaticDateTimeProvider(ZonedDateTime) - Constructor for class com.norconex.importer.handler.condition.impl.DateProviderFactory.StaticDateTimeProvider

status(PipelineStatus) - Method in class com.norconex.crawler.core.cluster.pipeline.PipelineProgress.PipelineProgressBuilder

status(PipelineStatus) - Method in class com.norconex.crawler.core.cluster.pipeline.PipelineResult.PipelineResultBuilder

statusCode(int) - Method in class com.norconex.crawler.fs.fetch.impl.GenericFileFetchResponse.GenericFileFetchResponseBuilder

statusCode(int) - Method in class com.norconex.crawler.fs.fetch.impl.GenericFolderPathsFetchResponse.GenericFolderPathsFetchResponseBuilder

statusCode(int) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetchResponse.HttpClientFetchResponseBuilder

STDERR - Enum constant in enum class com.norconex.committer.core.impl.LogCommitterConfig.LogLevel

STDOUT - Enum constant in enum class com.norconex.committer.core.impl.LogCommitterConfig.LogLevel

Step - Interface in com.norconex.crawler.core.cluster.pipeline

STEP_CRAWL_DOCUMENTS - Static variable in class com.norconex.crawler.core.cmd.crawl.pipeline.DefaultCrawlPipelineFactory

STEP_CRAWL_ORPHANS - Static variable in class com.norconex.crawler.core.cmd.crawl.pipeline.DefaultCrawlPipelineFactory

STEP_DELETE_ORPHANS - Static variable in class com.norconex.crawler.core.cmd.crawl.pipeline.DefaultCrawlPipelineFactory

STEP_INITIAL_QUEUE - Static variable in class com.norconex.crawler.core.cmd.crawl.pipeline.DefaultCrawlPipelineFactory

Step.StepProgress - Class in com.norconex.crawler.core.cluster.pipeline

stepCount(int) - Method in class com.norconex.crawler.core.cluster.pipeline.PipelineProgress.PipelineProgressBuilder

stepMessage(String) - Method in class com.norconex.crawler.core.cluster.pipeline.PipelineProgress.PipelineProgressBuilder

stepProgress(float) - Method in class com.norconex.crawler.core.cluster.pipeline.PipelineProgress.PipelineProgressBuilder

StepProgress(float, String) - Constructor for class com.norconex.crawler.core.cluster.pipeline.Step.StepProgress

StepRecord - Class in com.norconex.crawler.core.cluster.pipeline

A record holding information on a pipeline execution current step.

StepRecord() - Constructor for class com.norconex.crawler.core.cluster.pipeline.StepRecord

StepRecordCompactSerializer - Class in com.norconex.crawler.core.cluster.impl.hazelcast

Hazelcast Compact serializer for StepRecord.

StepRecordCompactSerializer() - Constructor for class com.norconex.crawler.core.cluster.impl.hazelcast.StepRecordCompactSerializer

stop() - Method in interface com.norconex.crawler.core.cluster.Cluster

Requests to stop the cluster.

stop() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastCluster

stop() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.pipeline.HazelcastPipelineManager

stop() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.pipeline.PipelineWorker

End this worker by stopping any active task first then closing.

stop() - Method in class com.norconex.crawler.core.cluster.impl.memory.LocalPipelineManager

stop() - Method in class com.norconex.crawler.core.cluster.impl.memory.MemoryCluster

stop() - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCluster

stop() - Method in interface com.norconex.crawler.core.cluster.pipeline.PipelineManager

Stops all pipeline executions.

stop() - Method in class com.norconex.crawler.core.cmd.crawl.CrawlerProgressLogger

stop() - Method in class com.norconex.crawler.web.fetch.impl.webdriver.HttpSniffer

stop(CrawlerSession) - Method in class com.norconex.crawler.core.cluster.pipeline.BaseStep

stop(CrawlerSession) - Method in interface com.norconex.crawler.core.cluster.pipeline.Step

Requests for the step to stop.

stop(String...) - Method in class com.norconex.crawler.core.Crawler

StopCommand - Class in com.norconex.crawler.core.cmd.stop

Command to stop a running crawler session.

StopCommand(CrawlerConfig, String[]) - Constructor for class com.norconex.crawler.core.cmd.stop.StopCommand

StopCrawlerOnMaxEventListener - Class in com.norconex.crawler.core.event.listeners

Alternative to CrawlerConfig.setMaxDocuments(int) for issuing a crawler stop request upon reaching specific event counts.

StopCrawlerOnMaxEventListener() - Constructor for class com.norconex.crawler.core.event.listeners.StopCrawlerOnMaxEventListener

StopCrawlerOnMaxEventListenerConfig - Class in com.norconex.crawler.core.event.listeners

Configuration for StopCrawlerOnMaxEventListener.

StopCrawlerOnMaxEventListenerConfig() - Constructor for class com.norconex.crawler.core.event.listeners.StopCrawlerOnMaxEventListenerConfig

StopCrawlerOnMaxEventListenerConfig.OnMultiple - Enum Class in com.norconex.crawler.core.event.listeners

stopOnExceptions - Static variable in class com.norconex.crawler.core.CrawlerConfig.Fields

STOPPED - Enum constant in enum class com.norconex.crawler.core.cluster.pipeline.PipelineStatus

STOPPED - Enum constant in enum class com.norconex.crawler.core.session.CrawlerState

STOPPING - Enum constant in enum class com.norconex.crawler.core.cluster.pipeline.PipelineStatus

stopPipeline() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.pipeline.PipelineExecution

stopPipeline(String) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.pipeline.HazelcastPipelineManager

stopPipeline(String) - Method in class com.norconex.crawler.core.cluster.impl.memory.LocalPipelineManager

stopPipeline(String) - Method in interface com.norconex.crawler.core.cluster.pipeline.PipelineManager

Stops a pipeline execution.

storageExport(Path, boolean) - Method in class com.norconex.crawler.core.Crawler

storageImport(Path) - Method in class com.norconex.crawler.core.Crawler

store(String, String) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.jdbc.StringJdbcMapStore

store(Long, String) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.jdbc.StringJdbcQueueStore

store(Long, T) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.jdbc.TypedJdbcQueueStore

storeAll(Map<Long, String>) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.jdbc.StringJdbcQueueStore

storeAll(Map<Long, T>) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.jdbc.TypedJdbcQueueStore

storeAll(Map<String, String>) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.jdbc.StringJdbcMapStore

StoreExportCommand - Class in com.norconex.crawler.core.cmd.storeexport

StoreExportCommand(Path, boolean) - Constructor for class com.norconex.crawler.core.cmd.storeexport.StoreExportCommand

StoreImportCommand - Class in com.norconex.crawler.core.cmd.storeimport

StoreImportCommand(Path) - Constructor for class com.norconex.crawler.core.cmd.storeimport.StoreImportCommand

Storing the image - Search tag in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolver

Section

Storing values in an existing field - Search tag in class com.norconex.importer.handler.transformer.impl.ConstantTransformer

Section

Storing values in an existing field - Search tag in class com.norconex.importer.handler.transformer.impl.ConstantTransformerConfig

Section

Storing values in an existing field - Search tag in class com.norconex.importer.handler.transformer.impl.CopyTransformer

Section

Storing values in an existing field - Search tag in class com.norconex.importer.handler.transformer.impl.CopyTransformerConfig

Section

Storing values in an existing field - Search tag in class com.norconex.importer.handler.transformer.impl.CountMatchesTransformer

Section

Storing values in an existing field - Search tag in class com.norconex.importer.handler.transformer.impl.CountMatchesTransformerConfig

Section

Storing values in an existing field - Search tag in class com.norconex.importer.handler.transformer.impl.CurrentDateTransformer

Section

Storing values in an existing field - Search tag in class com.norconex.importer.handler.transformer.impl.CurrentDateTransformerConfig

Section

Storing values in an existing field - Search tag in class com.norconex.importer.handler.transformer.impl.DateFormatTransformer

Section

Storing values in an existing field - Search tag in class com.norconex.importer.handler.transformer.impl.DateFormatTransformerConfig

Section

Storing values in an existing field - Search tag in class com.norconex.importer.handler.transformer.impl.DocumentLengthTransformer

Section

Storing values in an existing field - Search tag in class com.norconex.importer.handler.transformer.impl.DocumentLengthTransformerConfig

Section

Storing values in an existing field - Search tag in class com.norconex.importer.handler.transformer.impl.DomTransformer

Section

Storing values in an existing field - Search tag in class com.norconex.importer.handler.transformer.impl.DomTransformerConfig

Section

Storing values in an existing field - Search tag in class com.norconex.importer.handler.transformer.impl.HierarchyTransformer

Section

Storing values in an existing field - Search tag in class com.norconex.importer.handler.transformer.impl.HierarchyTransformerConfig

Section

Storing values in an existing field - Search tag in class com.norconex.importer.handler.transformer.impl.RegexTransformer

Section

Storing values in an existing field - Search tag in class com.norconex.importer.handler.transformer.impl.RegexTransformerConfig

Section

Storing values in an existing field - Search tag in class com.norconex.importer.handler.transformer.impl.RenameTransformer

Section

Storing values in an existing field - Search tag in class com.norconex.importer.handler.transformer.impl.RenameTransformerConfig

Section

Storing values in an existing field - Search tag in class com.norconex.importer.handler.transformer.impl.SplitTransformer

Section

Storing values in an existing field - Search tag in class com.norconex.importer.handler.transformer.impl.SplitTransformerConfig

Section

Storing values in an existing field - Search tag in class com.norconex.importer.handler.transformer.impl.TextBetweenTransformer

Section

Storing values in an existing field - Search tag in class com.norconex.importer.handler.transformer.impl.TextBetweenTransformerConfig

Section

Storing values in an existing field - Search tag in class com.norconex.importer.handler.transformer.impl.TitleGeneratorTransformer

Section

Storing values in an existing field - Search tag in class com.norconex.importer.handler.transformer.impl.TitleGeneratorTransformerConfig

Section

Storing values in an existing field - Search tag in class com.norconex.importer.handler.transformer.impl.TruncateTransformer

Section

Storing values in an existing field - Search tag in class com.norconex.importer.handler.transformer.impl.TruncateTransformerConfig

Section

Storing values in an existing field - Search tag in class com.norconex.importer.handler.transformer.impl.UrlExtractorTransformer

Section

Storing values in an existing field - Search tag in class com.norconex.importer.handler.transformer.impl.UrlExtractorTransformerConfig

Section

Storing values in an existing field - Search tag in class com.norconex.importer.handler.transformer.impl.UuidTransformer

Section

Storing values in an existing field - Search tag in class com.norconex.importer.handler.transformer.impl.UuidTransformerConfig

Section

streamFactory() - Method in class com.norconex.importer.handler.DocHandlerContext

streamFactory(CachedStreamFactory) - Method in class com.norconex.crawler.core.context.CrawlerContext.Builder

STRICT - Enum constant in enum class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig.CookieSpec

StringJdbcMapStore - Class in com.norconex.crawler.core.cluster.impl.hazelcast.jdbc

JDBC-based key-value MapStore for Hazelcast OSS.

StringJdbcMapStore() - Constructor for class com.norconex.crawler.core.cluster.impl.hazelcast.jdbc.StringJdbcMapStore

StringJdbcQueueStore - Class in com.norconex.crawler.core.cluster.impl.hazelcast.jdbc

JDBC-backed Hazelcast QueueStore implementation that persists queue items in a text column in a table with an order column.

StringJdbcQueueStore(HazelcastInstance, String, Properties) - Constructor for class com.norconex.crawler.core.cluster.impl.hazelcast.jdbc.StringJdbcQueueStore

Construct the queue store using the DataSource attached to the provided HazelcastInstance.

StringSanitizer - Class in com.norconex.crawler.core.util

Sanitizes a string by stripping all characters but those identified.

StringSanitizer.Builder - Class in com.norconex.crawler.core.util

StripAfterTransformer - Class in com.norconex.importer.handler.transformer.impl

Strips any content found after first match found for given pattern.

StripAfterTransformer() - Constructor for class com.norconex.importer.handler.transformer.impl.StripAfterTransformer

StripAfterTransformerConfig - Class in com.norconex.importer.handler.transformer.impl

Strips any content found after first match found for given pattern.

StripAfterTransformerConfig() - Constructor for class com.norconex.importer.handler.transformer.impl.StripAfterTransformerConfig

StripBeforeTransformer - Class in com.norconex.importer.handler.transformer.impl

Strips any content found before first match found for given pattern.

StripBeforeTransformer() - Constructor for class com.norconex.importer.handler.transformer.impl.StripBeforeTransformer

StripBeforeTransformerConfig - Class in com.norconex.importer.handler.transformer.impl

Strips any content found before first match found for given pattern.

StripBeforeTransformerConfig() - Constructor for class com.norconex.importer.handler.transformer.impl.StripBeforeTransformerConfig

StripBetweenOperation - Class in com.norconex.importer.handler.transformer.impl

StripBetweenOperation() - Constructor for class com.norconex.importer.handler.transformer.impl.StripBetweenOperation

StripBetweenTransformer - Class in com.norconex.importer.handler.transformer.impl

Strips any content found between a matching start and end strings.

StripBetweenTransformer() - Constructor for class com.norconex.importer.handler.transformer.impl.StripBetweenTransformer

StripBetweenTransformerConfig - Class in com.norconex.importer.handler.transformer.impl

Strips any content found between a matching start and end strings.

StripBetweenTransformerConfig() - Constructor for class com.norconex.importer.handler.transformer.impl.StripBetweenTransformerConfig

StructuredDataMapping() - Constructor for class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.StructuredDataMapping

subject(Object) - Method in class com.norconex.committer.core.service.CommitterServiceEvent.CommitterServiceEventBuilder

subject(S) - Method in class com.norconex.crawler.core.doc.pipelines.OnMatchFiltersResolver.OnMatchFiltersResolverBuilder

subpath(int, int) - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyPath

SubstringTransformer - Class in com.norconex.importer.handler.transformer.impl

Keep a substring of the content matching a begin and end character indexes.

SubstringTransformer() - Constructor for class com.norconex.importer.handler.transformer.impl.SubstringTransformer

SubstringTransformerConfig - Class in com.norconex.importer.handler.transformer.impl

Keep a substring of the content matching a begin and end character indexes.

SubstringTransformerConfig() - Constructor for class com.norconex.importer.handler.transformer.impl.SubstringTransformerConfig

SUCCESS - Enum constant in enum class com.norconex.importer.response.ImporterResponse.Status

SUM - Enum constant in enum class com.norconex.crawler.core.event.listeners.StopCrawlerOnMaxEventListenerConfig.OnMultiple

Stop the crawler when the sum of all matching event counts have reached the maximum.

SUN - Enum constant in enum class com.norconex.crawler.web.doc.operations.delay.impl.DelaySchedule.DOW

supplyWithAutoShutdown(Supplier<T>, ExecutorService) - Static method in class com.norconex.crawler.core.util.ConcurrentUtil

Supported archive schemes (outer layer) - Search tag in class com.norconex.crawler.fs.fetch.impl.archive.ArchiveFetcher

Section

Supported events - Search tag in class com.norconex.crawler.core.event.listeners.DeleteRejectedEventListener

Section

supportedFileAttributeViews() - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyFileSystem

Supported HTTP method - Search tag in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcher

Section

Supported HTTP method - Search tag in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcher

Section

Supported Languages: - Search tag in class com.norconex.importer.handler.transformer.impl.LanguageTransformer

Section

Supported Languages: - Search tag in class com.norconex.importer.handler.transformer.impl.LanguageTransformerConfig

Section

swallow(FailableRunnable<Exception>) - Static method in class com.norconex.crawler.core.util.ExceptionSwallower

Ensures that any exceptions thrown while executing are swallowed and a default message logged.

swallow(FailableRunnable<Exception>, String) - Static method in class com.norconex.crawler.core.util.ExceptionSwallower

Ensures that any exceptions thrown while executing are swallowed and a custom message logged.

swallowQuietly(FailableRunnable<Exception>) - Static method in class com.norconex.crawler.core.util.ExceptionSwallower

Ensures that any exceptions thrown while executing are swallowed and no messages are logged about the exception.

SYNCHRONOUS - Enum constant in enum class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.RequestMode

Higher-priority, latency-sensitive mode, rate-limited more strictly by Google Cloud Search.

SYS_PROP_ENABLE_JMX - Static variable in class com.norconex.crawler.core.cmd.crawl.CrawlerCommand

T

Table creation - Search tag in class com.norconex.committer.sql.SqlCommitter

Section

tableExists(String) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.jdbc.JdbcClient

TAGNAME - Enum constant in enum class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcherConfig.WaitElementType

Locate by HTML tag name.

TAGNAME - Enum constant in enum class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig.WaitElementType

Tags attributes - Search tag in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractor

Section

take() - Method in class com.norconex.crawler.core.cmd.crawl.pipeline.process.BatchDispatcher

takeScreenshot(T, Doc) - Method in class com.norconex.crawler.web.fetch.util.AbstractScreenshotHandler

Takes a screenshot of the given browser source and stores it according to the handler configuration.

TARGET_REDIRECT_CONTEXT_KEY - Static variable in class com.norconex.crawler.web.fetch.util.ApacheRedirectCaptureStrategy

TDF - Enum constant in enum class com.norconex.committer.core.fs.impl.CsvFileCommitterConfig.CsvFormat

tempDir(Path) - Method in class com.norconex.crawler.core.context.CrawlerContext.Builder

tessdataPath - Static variable in class com.norconex.importer.handler.parser.impl.OcrConfig.Fields

Tesseract Parameters - Search tag in class com.norconex.importer.handler.parser.impl.OcrConfig

Section

tesseractPath - Static variable in class com.norconex.importer.handler.parser.impl.OcrConfig.Fields

test(CommitterPipelineContext) - Method in class com.norconex.crawler.core.doc.pipelines.committer.stages.CommitModuleStage

test(CommitterPipelineContext) - Method in class com.norconex.crawler.core.doc.pipelines.committer.stages.DocumentChecksumStage

test(CommitterPipelineContext) - Method in class com.norconex.crawler.core.doc.pipelines.committer.stages.DocumentDedupStage

test(CommitterPipelineContext) - Method in class com.norconex.crawler.core.doc.pipelines.committer.stages.DocumentPostProcessingStage

test(CommitterPipelineContext) - Method in class com.norconex.crawler.web.doc.pipelines.committer.stages.PostImportLinksStage

test(ImporterPipelineContext) - Method in class com.norconex.crawler.core.doc.pipelines.importer.stages.AbstractImporterStage

test(ImporterPipelineContext) - Method in class com.norconex.crawler.core.doc.pipelines.importer.stages.CommonAttribsResolutionStage

test(ImporterPipelineContext) - Method in class com.norconex.crawler.core.doc.pipelines.importer.stages.DocumentFiltersStage

test(ImporterPipelineContext) - Method in class com.norconex.crawler.core.doc.pipelines.importer.stages.ImportModuleStage

test(QueuePipelineContext) - Method in class com.norconex.crawler.core.doc.pipelines.queue.stages.DepthValidationStage

test(QueuePipelineContext) - Method in class com.norconex.crawler.core.doc.pipelines.queue.stages.QueueReferenceStage

test(QueuePipelineContext) - Method in class com.norconex.crawler.core.doc.pipelines.queue.stages.ReferenceFiltersStage

test(QueuePipelineContext) - Method in class com.norconex.crawler.web.doc.pipelines.queue.stages.RobotsTxtFiltersStage

test(QueuePipelineContext) - Method in class com.norconex.crawler.web.doc.pipelines.queue.stages.SitemapResolutionStage

test(QueuePipelineContext) - Method in class com.norconex.crawler.web.doc.pipelines.queue.stages.UrlNormalizerStage

test(DocHandlerContext) - Method in class com.norconex.importer.handler.condition.AllOf

test(DocHandlerContext) - Method in class com.norconex.importer.handler.condition.AnyOf

test(DocHandlerContext) - Method in class com.norconex.importer.handler.condition.impl.BlankCondition

test(DocHandlerContext) - Method in class com.norconex.importer.handler.condition.impl.DateCondition

test(DocHandlerContext) - Method in class com.norconex.importer.handler.condition.impl.DomCondition

test(DocHandlerContext) - Method in class com.norconex.importer.handler.condition.impl.NumericCondition

test(DocHandlerContext) - Method in class com.norconex.importer.handler.condition.impl.ReferenceCondition

test(DocHandlerContext) - Method in class com.norconex.importer.handler.condition.impl.ScriptCondition

test(DocHandlerContext) - Method in class com.norconex.importer.handler.condition.impl.TextCondition

test(DocHandlerContext) - Method in class com.norconex.importer.handler.condition.NoneOf

test(Double) - Method in class com.norconex.importer.handler.condition.impl.NumericValueMatcher

test(ZonedDateTime) - Method in class com.norconex.importer.handler.condition.impl.DateValueMatcher

TEXT - Enum constant in enum class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.StructuredDataType

TEXT - Enum constant in enum class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.UploadFormat

Upload the extracted plain-text content.

TEXT - Enum constant in enum class com.norconex.crawler.fs.fetch.impl.googledrive.GoogleDriveFetcherConfig.NativeDocumentFormatPolicy

TextBetweenOperation - Class in com.norconex.importer.handler.transformer.impl

TextBetweenOperation() - Constructor for class com.norconex.importer.handler.transformer.impl.TextBetweenOperation

TextBetweenTransformer - Class in com.norconex.importer.handler.transformer.impl

Extracts and add values found between a matching start and end strings to a document metadata field.

TextBetweenTransformer() - Constructor for class com.norconex.importer.handler.transformer.impl.TextBetweenTransformer

TextBetweenTransformerConfig - Class in com.norconex.importer.handler.transformer.impl

Extracts and add values found between a matching start and end strings to a document metadata field.

TextBetweenTransformerConfig() - Constructor for class com.norconex.importer.handler.transformer.impl.TextBetweenTransformerConfig

TextChunk - Class in com.norconex.importer.util.chunk

TextChunk(String, int, int, String) - Constructor for class com.norconex.importer.util.chunk.TextChunk

Creates a new TextChunk instance.

TextCondition - Class in com.norconex.importer.handler.condition.impl

A condition based on a text pattern matching a document content (default), or matching specific field(s).

TextCondition() - Constructor for class com.norconex.importer.handler.condition.impl.TextCondition

TextCondition(TextMatcher) - Constructor for class com.norconex.importer.handler.condition.impl.TextCondition

TextCondition(TextMatcher, TextMatcher) - Constructor for class com.norconex.importer.handler.condition.impl.TextCondition

TextConditionConfig - Class in com.norconex.importer.handler.condition.impl

A condition based on a text pattern matching a document content (default), or matching specific field(s).

TextConditionConfig() - Constructor for class com.norconex.importer.handler.condition.impl.TextConditionConfig

TextStatisticsTransformer - Class in com.norconex.importer.handler.transformer.impl

Analyzes the content of the supplied document and adds statistical information about its content or field as metadata fields.

TextStatisticsTransformer() - Constructor for class com.norconex.importer.handler.transformer.impl.TextStatisticsTransformer

TextStatisticsTransformerConfig - Class in com.norconex.importer.handler.transformer.impl

Analyzes the content of the supplied document and adds statistical information about its content or field as metadata fields.

TextStatisticsTransformerConfig() - Constructor for class com.norconex.importer.handler.transformer.impl.TextStatisticsTransformerConfig

THREAD - Enum constant in enum class com.norconex.crawler.web.doc.operations.delay.impl.BaseDelayResolverConfig.DelayResolverScope

ThreadDelay - Class in com.norconex.crawler.web.doc.operations.delay.impl

ThreadDelay() - Constructor for class com.norconex.crawler.web.doc.operations.delay.impl.ThreadDelay

threadFactoryCreator(ScopedThreadFactoryCreator) - Method in class com.norconex.crawler.core.context.CrawlerContext.Builder

Thread safety - Search tag in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcher

Section

ThreadTracker - Class in com.norconex.crawler.core.util

THU - Enum constant in enum class com.norconex.crawler.web.doc.operations.delay.impl.DelaySchedule.DOW

TikaLinkExtractor - Class in com.norconex.crawler.web.doc.operations.link.impl

Implementation of LinkExtractor using Apache Tika to perform URL extractions from HTML documents.

TikaLinkExtractor() - Constructor for class com.norconex.crawler.web.doc.operations.link.impl.TikaLinkExtractor

TikaLinkExtractorConfig - Class in com.norconex.crawler.web.doc.operations.link.impl

Configuration for TikaLinkExtractor.

TikaLinkExtractorConfig() - Constructor for class com.norconex.crawler.web.doc.operations.link.impl.TikaLinkExtractorConfig

TikaParser - Class in com.norconex.importer.handler.parser.impl

Raw Tika parser that needs to be configured by passing a tika configuration file.

TikaParser() - Constructor for class com.norconex.importer.handler.parser.impl.TikaParser

TikaParserConfig - Class in com.norconex.importer.handler.parser.impl

TikaParserConfig() - Constructor for class com.norconex.importer.handler.parser.impl.TikaParserConfig

timedOut(boolean) - Method in class com.norconex.crawler.core.cluster.pipeline.PipelineResult.PipelineResultBuilder

Timeouts - Search tag in class com.norconex.committer.elasticsearch.ElasticsearchCommitter

Section

timeoutSeconds - Static variable in class com.norconex.importer.handler.parser.impl.OcrConfig.Fields

TIMESTAMP - Enum constant in enum class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.StructuredDataType

Time zones: - Search tag in class com.norconex.importer.handler.condition.impl.DateCondition

Section

Time zones: - Search tag in class com.norconex.importer.handler.condition.impl.DateConditionConfig

Section

Time zones: - Search tag in class com.norconex.importer.handler.condition.impl.DateProviderFactory

Section

TINY_SLEEP_MS - Static variable in class com.norconex.crawler.web.doc.operations.delay.impl.AbstractDelay

TITLE - Enum constant in enum class com.norconex.committer.googlecloudsearch.MetadataField

TitleGeneratorTransformer - Class in com.norconex.importer.handler.transformer.impl

Attempts to generate a title from the document content (default) or a specified metadata field.

TitleGeneratorTransformer() - Constructor for class com.norconex.importer.handler.transformer.impl.TitleGeneratorTransformer

TitleGeneratorTransformerConfig - Class in com.norconex.importer.handler.transformer.impl

Attempts to generate a title from the document content (default) or a specified metadata field.

TitleGeneratorTransformerConfig() - Constructor for class com.norconex.importer.handler.transformer.impl.TitleGeneratorTransformerConfig

toAbsolutePath() - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyPath

toBuilder() - Method in class com.norconex.crawler.core.cluster.pipeline.PipelineResult

toBuilder() - Method in class com.norconex.crawler.core.context.CrawlerContext

toField - Static variable in class com.norconex.importer.handler.transformer.impl.DateFormatTransformerConfig.Fields

toFile() - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyPath

toFormat - Static variable in class com.norconex.importer.handler.transformer.impl.DateFormatTransformerConfig.Fields

toHTMLInlineString(String) - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImage

toJsonReader(Object) - Static method in class com.norconex.crawler.core.util.SerialUtil

toJsonString(Object) - Static method in class com.norconex.crawler.core.util.SerialUtil

toJSoupParser(String) - Static method in class com.norconex.importer.util.DomUtil

Gets the JSoup parser associated with the string representation.

TOKEN_INPUT - Static variable in class com.norconex.importer.handler.transformer.impl.ExternalTransformerConfig

TOKEN_INPUT_META - Static variable in class com.norconex.importer.handler.transformer.impl.ExternalTransformerConfig

TOKEN_OUTPUT - Static variable in class com.norconex.importer.handler.transformer.impl.ExternalTransformerConfig

TOKEN_OUTPUT_META - Static variable in class com.norconex.importer.handler.transformer.impl.ExternalTransformerConfig

TOKEN_REFERENCE - Static variable in class com.norconex.importer.handler.transformer.impl.ExternalTransformerConfig

toLocale - Static variable in class com.norconex.importer.handler.transformer.impl.DateFormatTransformerConfig.Fields

TOO_DEEP - Static variable in class com.norconex.crawler.core.ledger.ProcessingOutcome

Topic Creation - Search tag in class com.norconex.committer.apachekafka.ApacheKafkaCommitter

Section

toRealPath(LinkOption...) - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyPath

toString() - Method in class com.norconex.committer.amazoncloudsearch.AmazonCloudSearchCommitter

toString() - Method in class com.norconex.committer.amazoncloudsearch.AmazonCloudSearchCommitterConfig

toString() - Method in class com.norconex.committer.apachekafka.ApacheKafkaCommitter

toString() - Method in class com.norconex.committer.apachekafka.ApacheKafkaCommitterConfig

toString() - Method in class com.norconex.committer.azurecognitivesearch.AzureSearchCommitter

toString() - Method in class com.norconex.committer.azurecognitivesearch.AzureSearchCommitterConfig

toString() - Method in class com.norconex.committer.core.AbstractCommitter

toString() - Method in class com.norconex.committer.core.BaseCommitterConfig

toString() - Method in class com.norconex.committer.core.batch.AbstractBatchCommitter

toString() - Method in class com.norconex.committer.core.batch.BaseBatchCommitterConfig

toString() - Method in class com.norconex.committer.core.batch.queue.impl.FsQueue

toString() - Method in class com.norconex.committer.core.batch.queue.impl.FsQueueConfig.OnCommitFailure

toString() - Method in class com.norconex.committer.core.batch.queue.impl.FsQueueConfig

toString() - Method in class com.norconex.committer.core.CommitterContext

toString() - Method in class com.norconex.committer.core.CommitterEvent.CommitterEventBuilder

toString() - Method in class com.norconex.committer.core.CommitterEvent

toString() - Method in class com.norconex.committer.core.DeleteRequest

toString() - Method in class com.norconex.committer.core.fs.AbstractFsCommitter

toString() - Method in class com.norconex.committer.core.fs.BaseFsCommitterConfig

toString() - Method in class com.norconex.committer.core.fs.impl.CsvColumn

toString() - Method in class com.norconex.committer.core.fs.impl.CsvFileCommitter

toString() - Method in class com.norconex.committer.core.fs.impl.CsvFileCommitterConfig

toString() - Method in class com.norconex.committer.core.fs.impl.JsonFileCommitter

toString() - Method in class com.norconex.committer.core.fs.impl.JsonFileCommitterConfig

toString() - Method in class com.norconex.committer.core.fs.impl.XmlFileCommitter

toString() - Method in class com.norconex.committer.core.fs.impl.XmlFileCommitterConfig

toString() - Method in class com.norconex.committer.core.impl.LogCommitter

toString() - Method in class com.norconex.committer.core.impl.LogCommitterConfig

toString() - Method in class com.norconex.committer.core.impl.MemoryCommitter

toString() - Method in class com.norconex.committer.core.impl.MemoryCommitterConfig

toString() - Method in class com.norconex.committer.core.service.CommitterService.CommitterServiceBuilder

toString() - Method in class com.norconex.committer.core.service.CommitterService

toString() - Method in class com.norconex.committer.core.service.CommitterServiceEvent.CommitterServiceEventBuilder

toString() - Method in class com.norconex.committer.core.service.CommitterServiceEvent

toString() - Method in class com.norconex.committer.core.UpsertRequest

toString() - Method in class com.norconex.committer.elasticsearch.ElasticsearchCommitter

toString() - Method in class com.norconex.committer.elasticsearch.ElasticsearchCommitterConfig

toString() - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitter

toString() - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.AclInheritanceMapping

toString() - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.AclMapping

toString() - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.MetadataMapping

toString() - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.StructuredDataMapping

toString() - Method in class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig

toString() - Method in enum class com.norconex.committer.googlecloudsearch.MetadataField

toString() - Method in class com.norconex.committer.idol.IdolCommitter

toString() - Method in class com.norconex.committer.idol.IdolCommitterConfig

toString() - Method in class com.norconex.committer.neo4j.Neo4jCommitter

toString() - Method in class com.norconex.committer.neo4j.Neo4jCommitterConfig

toString() - Method in enum class com.norconex.committer.solr.SolrClientType

toString() - Method in class com.norconex.committer.solr.SolrCommitter

toString() - Method in class com.norconex.committer.solr.SolrCommitterConfig

toString() - Method in class com.norconex.committer.sql.SqlCommitter

toString() - Method in class com.norconex.committer.sql.SqlCommitterConfig

toString() - Method in class com.norconex.crawler.core.cli.CliBase

toString() - Method in class com.norconex.crawler.core.cli.CliConfigRender

toString() - Method in class com.norconex.crawler.core.cli.CliRunner

toString() - Method in class com.norconex.crawler.core.cli.CliStart

toString() - Method in class com.norconex.crawler.core.cli.CliStop

toString() - Method in class com.norconex.crawler.core.cli.CliStoreExport

toString() - Method in class com.norconex.crawler.core.cli.CliStoreImport

toString() - Method in class com.norconex.crawler.core.cluster.admin.ClusterAdminClient.ClusterAdminClientBuilder

toString() - Method in class com.norconex.crawler.core.cluster.ClusterConfig

toString() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastClusterConnectorConfig

toString() - Method in record class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastConfigurerContext

Returns a string representation of this record class.

toString() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.JdbcHazelcastConfigurer

toString() - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreClusterConnectorConfig

toString() - Method in class com.norconex.crawler.core.cluster.pipeline.BaseStep

toString() - Method in class com.norconex.crawler.core.cluster.pipeline.Pipeline

toString() - Method in class com.norconex.crawler.core.cluster.pipeline.PipelineProgress.PipelineProgressBuilder

toString() - Method in class com.norconex.crawler.core.cluster.pipeline.PipelineProgress

toString() - Method in class com.norconex.crawler.core.cluster.pipeline.PipelineResult.PipelineResultBuilder

toString() - Method in class com.norconex.crawler.core.cluster.pipeline.PipelineResult

toString() - Method in class com.norconex.crawler.core.cluster.pipeline.Step.StepProgress

toString() - Method in class com.norconex.crawler.core.cluster.pipeline.StepRecord

toString() - Method in class com.norconex.crawler.core.cluster.QueryFilter

toString() - Method in class com.norconex.crawler.core.cluster.SerializedCache.SerializedEntry

toString() - Method in class com.norconex.crawler.core.cluster.SerializedCache

toString() - Method in class com.norconex.crawler.core.cluster.SerializedRecord

toString() - Method in class com.norconex.crawler.core.cmd.crawl.CrawlerProgressLogger

toString() - Method in class com.norconex.crawler.core.cmd.crawl.pipeline.process.BatchDispatcher.BatchDispatcherBuilder

toString() - Method in class com.norconex.crawler.core.context.CrawlerContext.Builder

toString() - Method in class com.norconex.crawler.core.context.CrawlerContext

toString() - Method in class com.norconex.crawler.core.context.CrawlerContextFactory.Builder

toString() - Method in class com.norconex.crawler.core.CrawlerCallbacks.CrawlerCallbacksBuilder

toString() - Method in class com.norconex.crawler.core.CrawlerConfig

toString() - Method in class com.norconex.crawler.core.CrawlerDriver.Builder

toString() - Method in class com.norconex.crawler.core.CrawlerDriver.FetchDriver

toString() - Method in class com.norconex.crawler.core.doc.CrawlerDocContext.CrawlerDocContextBuilder

toString() - Method in class com.norconex.crawler.core.doc.operations.checksum.AbstractDocumentChecksummer

toString() - Method in class com.norconex.crawler.core.doc.operations.checksum.AbstractMetadataChecksummer

toString() - Method in class com.norconex.crawler.core.doc.operations.checksum.BaseChecksummerConfig

toString() - Method in class com.norconex.crawler.core.doc.operations.checksum.impl.GenericMetadataChecksummer

toString() - Method in class com.norconex.crawler.core.doc.operations.checksum.impl.GenericMetadataChecksummerConfig

toString() - Method in class com.norconex.crawler.core.doc.operations.checksum.impl.Md5DocumentChecksummer

toString() - Method in class com.norconex.crawler.core.doc.operations.checksum.impl.Md5DocumentChecksummerConfig

toString() - Method in class com.norconex.crawler.core.doc.operations.filter.FilterGroupResolver.FilterGroupResolverBuilder

toString() - Method in class com.norconex.crawler.core.doc.operations.filter.impl.ExtensionReferenceFilter

toString() - Method in class com.norconex.crawler.core.doc.operations.filter.impl.ExtensionReferenceFilterConfig

toString() - Method in class com.norconex.crawler.core.doc.operations.filter.impl.GenericMetadataFilter

toString() - Method in class com.norconex.crawler.core.doc.operations.filter.impl.GenericMetadataFilterConfig

toString() - Method in class com.norconex.crawler.core.doc.operations.filter.impl.GenericReferenceFilter

toString() - Method in class com.norconex.crawler.core.doc.operations.filter.impl.GenericReferenceFilterConfig

toString() - Method in class com.norconex.crawler.core.doc.operations.spoil.impl.GenericSpoiledReferenceStrategizer

toString() - Method in class com.norconex.crawler.core.doc.operations.spoil.impl.GenericSpoiledReferenceStrategizerConfig

toString() - Method in class com.norconex.crawler.core.doc.pipelines.committer.CommitterPipeline.CommitterPipelineBuilder

toString() - Method in class com.norconex.crawler.core.doc.pipelines.committer.CommitterPipelineContext

toString() - Method in class com.norconex.crawler.core.doc.pipelines.CrawlerDocPipelines.CrawlerDocPipelinesBuilder

toString() - Method in class com.norconex.crawler.core.doc.pipelines.importer.ImporterPipeline.ImporterPipelineBuilder

toString() - Method in class com.norconex.crawler.core.doc.pipelines.importer.ImporterPipelineContext

toString() - Method in class com.norconex.crawler.core.doc.pipelines.OnMatchFiltersResolver.OnMatchFiltersResolverBuilder

toString() - Method in class com.norconex.crawler.core.doc.pipelines.queue.QueuePipeline.QueuePipelineBuilder

toString() - Method in class com.norconex.crawler.core.doc.pipelines.queue.QueuePipelineContext

toString() - Method in class com.norconex.crawler.core.event.CrawlerEvent.CrawlerEventBuilder

toString() - Method in class com.norconex.crawler.core.event.CrawlerEvent

toString() - Method in class com.norconex.crawler.core.event.listeners.CrawlerLifeCycleListener

toString() - Method in class com.norconex.crawler.core.event.listeners.DeleteRejectedEventListener

toString() - Method in class com.norconex.crawler.core.event.listeners.DeleteRejectedEventListenerConfig

toString() - Method in class com.norconex.crawler.core.event.listeners.StopCrawlerOnMaxEventListener

toString() - Method in class com.norconex.crawler.core.event.listeners.StopCrawlerOnMaxEventListenerConfig

toString() - Method in class com.norconex.crawler.core.fetch.AbstractFetcher

toString() - Method in class com.norconex.crawler.core.fetch.AggregatedFetchResponse

toString() - Method in class com.norconex.crawler.core.fetch.BaseFetcherConfig

toString() - Method in class com.norconex.crawler.core.fetch.MultiFetcher.Builder

toString() - Method in class com.norconex.crawler.core.ledger.CrawlerEntry

toString() - Method in class com.norconex.crawler.core.ledger.ProcessingOutcome

toString() - Method in class com.norconex.crawler.core.session.CrawlerRunInfo.CrawlerRunInfoBuilder

toString() - Method in class com.norconex.crawler.core.session.CrawlerRunInfo

toString() - Method in class com.norconex.crawler.core.session.CrawlerSession.State

toString() - Method in class com.norconex.crawler.core.session.CrawlerSession

toString() - Method in class com.norconex.crawler.core.util.StringSanitizer.Builder

toString() - Method in class com.norconex.crawler.fs.doc.operations.checksum.FsMetadataChecksummer

toString() - Method in class com.norconex.crawler.fs.fetch.AggregatedFileFetchResponse

toString() - Method in class com.norconex.crawler.fs.fetch.AggregatedFolderPathsResponse

toString() - Method in class com.norconex.crawler.fs.fetch.FileFetchRequest

toString() - Method in class com.norconex.crawler.fs.fetch.FolderPathsFetchRequest

toString() - Method in class com.norconex.crawler.fs.fetch.FsPath

toString() - Method in class com.norconex.crawler.fs.fetch.impl.AbstractNioFetcher

toString() - Method in class com.norconex.crawler.fs.fetch.impl.adlsgen2.AdlsGen2Fetcher

toString() - Method in class com.norconex.crawler.fs.fetch.impl.adlsgen2.AdlsGen2FetcherConfig

toString() - Method in class com.norconex.crawler.fs.fetch.impl.archive.ArchiveFetcher

toString() - Method in class com.norconex.crawler.fs.fetch.impl.archive.ArchiveFetcherConfig

toString() - Method in class com.norconex.crawler.fs.fetch.impl.azureblob.AzureBlobFetcher

toString() - Method in class com.norconex.crawler.fs.fetch.impl.azureblob.AzureBlobFetcherConfig

toString() - Method in class com.norconex.crawler.fs.fetch.impl.BaseAuthNioFetcherConfig

toString() - Method in class com.norconex.crawler.fs.fetch.impl.box.BoxFetcher

toString() - Method in class com.norconex.crawler.fs.fetch.impl.box.BoxFetcherConfig

toString() - Method in class com.norconex.crawler.fs.fetch.impl.cmis.CmisAtomSession

toString() - Method in class com.norconex.crawler.fs.fetch.impl.cmis.CmisFetcher

toString() - Method in class com.norconex.crawler.fs.fetch.impl.cmis.CmisFetcherConfig

toString() - Method in class com.norconex.crawler.fs.fetch.impl.egnyte.EgnyteFetcher

toString() - Method in class com.norconex.crawler.fs.fetch.impl.egnyte.EgnyteFetcherConfig

toString() - Method in record class com.norconex.crawler.fs.fetch.impl.FolderItemReferenceParser.Parsed

Returns a string representation of this record class.

toString() - Method in class com.norconex.crawler.fs.fetch.impl.ftp.FtpFetcher

toString() - Method in class com.norconex.crawler.fs.fetch.impl.ftp.FtpFetcherConfig

toString() - Method in class com.norconex.crawler.fs.fetch.impl.gcs.GcsFetcher

toString() - Method in class com.norconex.crawler.fs.fetch.impl.gcs.GcsFetcherConfig

toString() - Method in class com.norconex.crawler.fs.fetch.impl.GenericFileFetchResponse.GenericFileFetchResponseBuilder

toString() - Method in class com.norconex.crawler.fs.fetch.impl.GenericFileFetchResponse

toString() - Method in class com.norconex.crawler.fs.fetch.impl.GenericFolderPathsFetchResponse.GenericFolderPathsFetchResponseBuilder

toString() - Method in class com.norconex.crawler.fs.fetch.impl.GenericFolderPathsFetchResponse

toString() - Method in class com.norconex.crawler.fs.fetch.impl.googledrive.GoogleDriveFetcher

toString() - Method in class com.norconex.crawler.fs.fetch.impl.googledrive.GoogleDriveFetcherConfig

toString() - Method in class com.norconex.crawler.fs.fetch.impl.hdfs.HdfsFetcher

toString() - Method in class com.norconex.crawler.fs.fetch.impl.hdfs.HdfsFetcherConfig

toString() - Method in class com.norconex.crawler.fs.fetch.impl.hdfs.KerberosConfig

toString() - Method in class com.norconex.crawler.fs.fetch.impl.local.LocalFetcher

toString() - Method in class com.norconex.crawler.fs.fetch.impl.local.LocalFetcherConfig

toString() - Method in class com.norconex.crawler.fs.fetch.impl.m365graph.M365GraphFetcher

toString() - Method in class com.norconex.crawler.fs.fetch.impl.m365graph.M365GraphFetcherConfig

toString() - Method in class com.norconex.crawler.fs.fetch.impl.ReadOnlyPath

toString() - Method in class com.norconex.crawler.fs.fetch.impl.s3.S3Fetcher

toString() - Method in class com.norconex.crawler.fs.fetch.impl.s3.S3FetcherConfig

toString() - Method in class com.norconex.crawler.fs.fetch.impl.sftp.SftpFetcher

toString() - Method in class com.norconex.crawler.fs.fetch.impl.sftp.SftpFetcherConfig

toString() - Method in class com.norconex.crawler.fs.fetch.impl.smb.SmbFetcher

toString() - Method in class com.norconex.crawler.fs.fetch.impl.smb.SmbFetcherConfig

toString() - Method in class com.norconex.crawler.fs.fetch.impl.webdav.WebDavFetcher

toString() - Method in class com.norconex.crawler.fs.fetch.impl.webdav.WebDavFetcherConfig

toString() - Method in class com.norconex.crawler.fs.ledger.FsCrawlerEntry

toString() - Method in class com.norconex.crawler.web.doc.operations.canon.impl.GenericCanonicalLinkDetector

toString() - Method in class com.norconex.crawler.web.doc.operations.canon.impl.GenericCanonicalLinkDetectorConfig

toString() - Method in class com.norconex.crawler.web.doc.operations.checksum.impl.LastModifiedMetadataChecksummer

toString() - Method in class com.norconex.crawler.web.doc.operations.delay.impl.AbstractDelay

toString() - Method in class com.norconex.crawler.web.doc.operations.delay.impl.AbstractDelayResolver

toString() - Method in class com.norconex.crawler.web.doc.operations.delay.impl.BaseDelayResolverConfig

toString() - Method in class com.norconex.crawler.web.doc.operations.delay.impl.CrawlerDelay

toString() - Method in class com.norconex.crawler.web.doc.operations.delay.impl.DelayRange

toString() - Method in class com.norconex.crawler.web.doc.operations.delay.impl.DelayReferencePattern

toString() - Method in class com.norconex.crawler.web.doc.operations.delay.impl.DelaySchedule

toString() - Method in class com.norconex.crawler.web.doc.operations.delay.impl.GenericDelayResolver

toString() - Method in class com.norconex.crawler.web.doc.operations.delay.impl.GenericDelayResolverConfig

toString() - Method in class com.norconex.crawler.web.doc.operations.delay.impl.ReferenceDelayResolver

toString() - Method in class com.norconex.crawler.web.doc.operations.delay.impl.ReferenceDelayResolverConfig

toString() - Method in class com.norconex.crawler.web.doc.operations.delay.impl.SiteDelay

toString() - Method in class com.norconex.crawler.web.doc.operations.filter.impl.SegmentCountUrlFilter

toString() - Method in class com.norconex.crawler.web.doc.operations.filter.impl.SegmentCountUrlFilterConfig

toString() - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImage

toString() - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolver

toString() - Method in class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig

toString() - Method in class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractor

toString() - Method in class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractorConfig.LinkSelector

toString() - Method in class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractorConfig

toString() - Method in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractor

toString() - Method in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractorConfig.RegexPair

toString() - Method in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractorConfig

toString() - Method in class com.norconex.crawler.web.doc.operations.link.impl.RegexLinkExtractor

toString() - Method in class com.norconex.crawler.web.doc.operations.link.impl.RegexLinkExtractorConfig.ExtractionPattern

toString() - Method in class com.norconex.crawler.web.doc.operations.link.impl.RegexLinkExtractorConfig

toString() - Method in class com.norconex.crawler.web.doc.operations.link.impl.TikaLinkExtractor

toString() - Method in class com.norconex.crawler.web.doc.operations.link.impl.TikaLinkExtractorConfig

toString() - Method in class com.norconex.crawler.web.doc.operations.link.impl.XmlFeedLinkExtractor

toString() - Method in class com.norconex.crawler.web.doc.operations.link.impl.XmlFeedLinkExtractorConfig

toString() - Method in class com.norconex.crawler.web.doc.operations.link.Link

toString() - Method in class com.norconex.crawler.web.doc.operations.recrawl.impl.GenericRecrawlableResolver

toString() - Method in class com.norconex.crawler.web.doc.operations.recrawl.impl.GenericRecrawlableResolverConfig.MinFrequency

toString() - Method in class com.norconex.crawler.web.doc.operations.recrawl.impl.GenericRecrawlableResolverConfig

toString() - Method in class com.norconex.crawler.web.doc.operations.robot.impl.StandardRobotsMetaProvider

toString() - Method in class com.norconex.crawler.web.doc.operations.robot.impl.StandardRobotsMetaProviderConfig

toString() - Method in class com.norconex.crawler.web.doc.operations.robot.impl.StandardRobotsTxtProvider

toString() - Method in class com.norconex.crawler.web.doc.operations.robot.RobotsMeta

toString() - Method in class com.norconex.crawler.web.doc.operations.robot.RobotsTxt.RobotsTxtBuilder

toString() - Method in class com.norconex.crawler.web.doc.operations.robot.RobotsTxt

toString() - Method in class com.norconex.crawler.web.doc.operations.scope.impl.GenericUrlScopeResolver

toString() - Method in class com.norconex.crawler.web.doc.operations.scope.impl.GenericUrlScopeResolverConfig

toString() - Method in class com.norconex.crawler.web.doc.operations.sitemap.impl.GenericSitemapLocator

toString() - Method in class com.norconex.crawler.web.doc.operations.sitemap.impl.GenericSitemapLocatorConfig

toString() - Method in class com.norconex.crawler.web.doc.operations.sitemap.impl.GenericSitemapResolver

toString() - Method in class com.norconex.crawler.web.doc.operations.sitemap.impl.GenericSitemapResolverConfig

toString() - Method in class com.norconex.crawler.web.doc.operations.sitemap.SitemapContext.SitemapContextBuilder

toString() - Method in class com.norconex.crawler.web.doc.operations.sitemap.SitemapContext

toString() - Method in class com.norconex.crawler.web.doc.operations.sitemap.SitemapRecord

toString() - Method in class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizer

toString() - Method in class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizerConfig.NormalizationReplace

toString() - Method in class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizerConfig

toString() - Method in class com.norconex.crawler.web.doc.pipelines.importer.WebImporterPipelineContext

toString() - Method in class com.norconex.crawler.web.event.listeners.UrlStatusCrawlerEventListener

toString() - Method in class com.norconex.crawler.web.event.listeners.UrlStatusCrawlerEventListenerConfig

toString() - Method in class com.norconex.crawler.web.fetch.AggregatedWebFetchResponse

toString() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthConfig

toString() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcher

toString() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig

toString() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetchResponse.HttpClientFetchResponseBuilder

toString() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetchResponse

toString() - Method in class com.norconex.crawler.web.fetch.impl.httpclient.KerberosConfig

toString() - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcher

toString() - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcherConfig

toString() - Method in class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightScreenshotHandler

toString() - Method in class com.norconex.crawler.web.fetch.impl.webdriver.HttpSniffer

toString() - Method in class com.norconex.crawler.web.fetch.impl.webdriver.HttpSnifferConfig

toString() - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcher

toString() - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig

toString() - Method in class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverScreenshotHandler

toString() - Method in class com.norconex.crawler.web.fetch.util.AbstractScreenshotHandler

toString() - Method in class com.norconex.crawler.web.fetch.util.DocImageHandler

toString() - Method in class com.norconex.crawler.web.fetch.util.DocImageHandlerConfig

toString() - Method in class com.norconex.crawler.web.fetch.util.GenericRedirectUrlProvider

toString() - Method in class com.norconex.crawler.web.fetch.util.GenericRedirectUrlProviderConfig

toString() - Method in class com.norconex.crawler.web.fetch.util.ScreenshotHandlerConfig

toString() - Method in class com.norconex.crawler.web.fetch.WebFetchRequest

toString() - Method in class com.norconex.crawler.web.ledger.WebCrawlerEntry

toString() - Method in class com.norconex.crawler.web.WebCrawlerConfig

toString() - Method in class com.norconex.importer.charset.CharsetDetector.CharsetDetectorBuilder

toString() - Method in class com.norconex.importer.doc.Doc

toString() - Method in class com.norconex.importer.handler.BaseLabelableConfig

toString() - Method in class com.norconex.importer.handler.condition.AllOf

toString() - Method in class com.norconex.importer.handler.condition.AnyOf

toString() - Method in class com.norconex.importer.handler.condition.ConditionalDocHandler

toString() - Method in class com.norconex.importer.handler.condition.ConditionGroup

toString() - Method in class com.norconex.importer.handler.condition.impl.BlankCondition

toString() - Method in class com.norconex.importer.handler.condition.impl.BlankConditionConfig

toString() - Method in enum class com.norconex.importer.handler.condition.impl.DateCondition.TimeUnit

toString() - Method in class com.norconex.importer.handler.condition.impl.DateCondition

toString() - Method in class com.norconex.importer.handler.condition.impl.DateConditionConfig

toString() - Method in class com.norconex.importer.handler.condition.impl.DateProviderFactory.DynamicFixedDateTimeProvider

toString() - Method in class com.norconex.importer.handler.condition.impl.DateProviderFactory.DynamicFloatingDateTimeProvider

toString() - Method in class com.norconex.importer.handler.condition.impl.DateProviderFactory.StaticDateTimeProvider

toString() - Method in class com.norconex.importer.handler.condition.impl.DateValueMatcher

toString() - Method in class com.norconex.importer.handler.condition.impl.DomCondition

toString() - Method in class com.norconex.importer.handler.condition.impl.DomConditionConfig

toString() - Method in class com.norconex.importer.handler.condition.impl.NumericCondition

toString() - Method in class com.norconex.importer.handler.condition.impl.NumericConditionConfig

toString() - Method in class com.norconex.importer.handler.condition.impl.NumericValueMatcher

toString() - Method in class com.norconex.importer.handler.condition.impl.ReferenceCondition

toString() - Method in class com.norconex.importer.handler.condition.impl.ReferenceConditionConfig

toString() - Method in class com.norconex.importer.handler.condition.impl.ScriptCondition

toString() - Method in class com.norconex.importer.handler.condition.impl.ScriptConditionConfig

toString() - Method in class com.norconex.importer.handler.condition.impl.TextCondition

toString() - Method in class com.norconex.importer.handler.condition.impl.TextConditionConfig

toString() - Method in class com.norconex.importer.handler.condition.NoneOf

toString() - Method in class com.norconex.importer.handler.DocHandlerContext.DocHandlerContextBuilder

toString() - Method in class com.norconex.importer.handler.DocHandlerContext

toString() - Method in class com.norconex.importer.handler.parser.impl.DefaultParser

toString() - Method in class com.norconex.importer.handler.parser.impl.DefaultParserConfig

toString() - Method in class com.norconex.importer.handler.parser.impl.EmbeddedConfig

toString() - Method in class com.norconex.importer.handler.parser.impl.ExternalParser

toString() - Method in class com.norconex.importer.handler.parser.impl.GrobidConfig

toString() - Method in class com.norconex.importer.handler.parser.impl.OcrConfig

toString() - Method in class com.norconex.importer.handler.parser.impl.SentimentConfig

toString() - Method in class com.norconex.importer.handler.parser.impl.TikaParser

toString() - Method in class com.norconex.importer.handler.parser.impl.TikaParserConfig

toString() - Method in class com.norconex.importer.handler.Reject

toString() - Method in class com.norconex.importer.handler.RejectConfig

toString() - Method in class com.norconex.importer.handler.ScriptRunner

toString() - Method in class com.norconex.importer.handler.splitter.AbstractDocumentSplitter

toString() - Method in class com.norconex.importer.handler.splitter.BaseDocumentSplitterConfig

toString() - Method in class com.norconex.importer.handler.splitter.impl.CsvSplitter

toString() - Method in class com.norconex.importer.handler.splitter.impl.CsvSplitterConfig

toString() - Method in class com.norconex.importer.handler.splitter.impl.DomSplitter

toString() - Method in class com.norconex.importer.handler.splitter.impl.DomSplitterConfig

toString() - Method in class com.norconex.importer.handler.splitter.impl.PdfPageSplitter

toString() - Method in class com.norconex.importer.handler.splitter.impl.PdfPageSplitterConfig

toString() - Method in class com.norconex.importer.handler.splitter.impl.TranslatorSplitter

toString() - Method in class com.norconex.importer.handler.splitter.impl.TranslatorSplitterConfig

toString() - Method in class com.norconex.importer.handler.splitter.impl.XmlStreamSplitter

toString() - Method in class com.norconex.importer.handler.splitter.impl.XmlStreamSplitterConfig

toString() - Method in class com.norconex.importer.handler.transformer.impl.BinaryContentTransformer

toString() - Method in class com.norconex.importer.handler.transformer.impl.BinaryContentTransformerConfig

toString() - Method in class com.norconex.importer.handler.transformer.impl.CharacterCaseTransformer

toString() - Method in class com.norconex.importer.handler.transformer.impl.CharacterCaseTransformerConfig

toString() - Method in class com.norconex.importer.handler.transformer.impl.CharsetTransformer

toString() - Method in class com.norconex.importer.handler.transformer.impl.CharsetTransformerConfig

toString() - Method in class com.norconex.importer.handler.transformer.impl.CollapseRepeatingTransformer

toString() - Method in class com.norconex.importer.handler.transformer.impl.CollapseRepeatingTransformerConfig

toString() - Method in class com.norconex.importer.handler.transformer.impl.Constant

toString() - Method in class com.norconex.importer.handler.transformer.impl.ConstantTransformer

toString() - Method in class com.norconex.importer.handler.transformer.impl.ConstantTransformerConfig

toString() - Method in class com.norconex.importer.handler.transformer.impl.CopyOperation

toString() - Method in class com.norconex.importer.handler.transformer.impl.CopyTransformer

toString() - Method in class com.norconex.importer.handler.transformer.impl.CopyTransformerConfig

toString() - Method in class com.norconex.importer.handler.transformer.impl.CountMatchesTransformer

toString() - Method in class com.norconex.importer.handler.transformer.impl.CountMatchesTransformerConfig

toString() - Method in class com.norconex.importer.handler.transformer.impl.CurrentDateTransformer

toString() - Method in class com.norconex.importer.handler.transformer.impl.CurrentDateTransformerConfig

toString() - Method in class com.norconex.importer.handler.transformer.impl.DateFormatTransformer

toString() - Method in class com.norconex.importer.handler.transformer.impl.DateFormatTransformerConfig

toString() - Method in class com.norconex.importer.handler.transformer.impl.DebugTransformer

toString() - Method in class com.norconex.importer.handler.transformer.impl.DebugTransformerConfig

toString() - Method in class com.norconex.importer.handler.transformer.impl.DeleteTransformer

toString() - Method in class com.norconex.importer.handler.transformer.impl.DeleteTransformerConfig

toString() - Method in class com.norconex.importer.handler.transformer.impl.DocumentLengthTransformer

toString() - Method in class com.norconex.importer.handler.transformer.impl.DocumentLengthTransformerConfig

toString() - Method in class com.norconex.importer.handler.transformer.impl.DomOperation

toString() - Method in class com.norconex.importer.handler.transformer.impl.DomTransformer

toString() - Method in class com.norconex.importer.handler.transformer.impl.DomTransformerConfig

toString() - Method in class com.norconex.importer.handler.transformer.impl.ExternalTransformer

toString() - Method in class com.norconex.importer.handler.transformer.impl.ExternalTransformerConfig

toString() - Method in class com.norconex.importer.handler.transformer.impl.FieldReportTransformer

toString() - Method in class com.norconex.importer.handler.transformer.impl.FieldReportTransformerConfig

toString() - Method in class com.norconex.importer.handler.transformer.impl.ForceSingleValueTransformer

toString() - Method in class com.norconex.importer.handler.transformer.impl.ForceSingleValueTransformerConfig

toString() - Method in class com.norconex.importer.handler.transformer.impl.HierarchyOperation

toString() - Method in class com.norconex.importer.handler.transformer.impl.HierarchyTransformer

toString() - Method in class com.norconex.importer.handler.transformer.impl.HierarchyTransformerConfig

toString() - Method in class com.norconex.importer.handler.transformer.impl.ImageTransformer

toString() - Method in class com.norconex.importer.handler.transformer.impl.ImageTransformerConfig.Crop

toString() - Method in class com.norconex.importer.handler.transformer.impl.ImageTransformerConfig.Scale

toString() - Method in class com.norconex.importer.handler.transformer.impl.ImageTransformerConfig

toString() - Method in class com.norconex.importer.handler.transformer.impl.KeepOnlyTransformer

toString() - Method in class com.norconex.importer.handler.transformer.impl.KeepOnlyTransformerConfig

toString() - Method in class com.norconex.importer.handler.transformer.impl.LanguageTransformer

toString() - Method in class com.norconex.importer.handler.transformer.impl.LanguageTransformerConfig

toString() - Method in class com.norconex.importer.handler.transformer.impl.MergeOperation

toString() - Method in class com.norconex.importer.handler.transformer.impl.MergeTransformer

toString() - Method in class com.norconex.importer.handler.transformer.impl.MergeTransformerConfig

toString() - Method in class com.norconex.importer.handler.transformer.impl.RegexTransformer

toString() - Method in class com.norconex.importer.handler.transformer.impl.RegexTransformerConfig

toString() - Method in class com.norconex.importer.handler.transformer.impl.RenameOperation

toString() - Method in class com.norconex.importer.handler.transformer.impl.RenameTransformer

toString() - Method in class com.norconex.importer.handler.transformer.impl.RenameTransformerConfig

toString() - Method in class com.norconex.importer.handler.transformer.impl.ReplaceOperation

toString() - Method in class com.norconex.importer.handler.transformer.impl.ReplaceTransformer

toString() - Method in class com.norconex.importer.handler.transformer.impl.ReplaceTransformerConfig

toString() - Method in class com.norconex.importer.handler.transformer.impl.SaveDocumentTransformer

toString() - Method in class com.norconex.importer.handler.transformer.impl.SaveDocumentTransformerConfig

toString() - Method in class com.norconex.importer.handler.transformer.impl.ScriptTransformer

toString() - Method in class com.norconex.importer.handler.transformer.impl.ScriptTransformerConfig

toString() - Method in class com.norconex.importer.handler.transformer.impl.SplitOperation

toString() - Method in class com.norconex.importer.handler.transformer.impl.SplitTransformer

toString() - Method in class com.norconex.importer.handler.transformer.impl.SplitTransformerConfig

toString() - Method in class com.norconex.importer.handler.transformer.impl.StripAfterTransformer

toString() - Method in class com.norconex.importer.handler.transformer.impl.StripAfterTransformerConfig

toString() - Method in class com.norconex.importer.handler.transformer.impl.StripBeforeTransformer

toString() - Method in class com.norconex.importer.handler.transformer.impl.StripBeforeTransformerConfig

toString() - Method in class com.norconex.importer.handler.transformer.impl.StripBetweenOperation

toString() - Method in class com.norconex.importer.handler.transformer.impl.StripBetweenTransformer

toString() - Method in class com.norconex.importer.handler.transformer.impl.StripBetweenTransformerConfig

toString() - Method in class com.norconex.importer.handler.transformer.impl.SubstringTransformer

toString() - Method in class com.norconex.importer.handler.transformer.impl.SubstringTransformerConfig

toString() - Method in class com.norconex.importer.handler.transformer.impl.TextBetweenOperation

toString() - Method in class com.norconex.importer.handler.transformer.impl.TextBetweenTransformer

toString() - Method in class com.norconex.importer.handler.transformer.impl.TextBetweenTransformerConfig

toString() - Method in class com.norconex.importer.handler.transformer.impl.TextStatisticsTransformer

toString() - Method in class com.norconex.importer.handler.transformer.impl.TextStatisticsTransformerConfig

toString() - Method in class com.norconex.importer.handler.transformer.impl.TitleGeneratorTransformer

toString() - Method in class com.norconex.importer.handler.transformer.impl.TitleGeneratorTransformerConfig

toString() - Method in class com.norconex.importer.handler.transformer.impl.TruncateTransformer

toString() - Method in class com.norconex.importer.handler.transformer.impl.TruncateTransformerConfig

toString() - Method in class com.norconex.importer.handler.transformer.impl.UrlExtractorTransformer

toString() - Method in class com.norconex.importer.handler.transformer.impl.UrlExtractorTransformerConfig

toString() - Method in class com.norconex.importer.handler.transformer.impl.UuidTransformer

toString() - Method in class com.norconex.importer.handler.transformer.impl.UuidTransformerConfig

toString() - Method in class com.norconex.importer.Importer

toString() - Method in class com.norconex.importer.ImporterConfig

toString() - Method in class com.norconex.importer.ImporterEvent.ImporterEventBuilder

toString() - Method in class com.norconex.importer.ImporterEvent

A string representation of this event.

toString() - Method in class com.norconex.importer.ImporterRequest

toString() - Method in class com.norconex.importer.response.ImporterResponse

toString() - Method in class com.norconex.importer.util.chunk.ChunkedTextReader.ChunkedTextReaderBuilder

toString() - Method in class com.norconex.importer.util.chunk.TextChunk

toString() - Method in class com.norconex.importer.util.ReadAdapter.ChunkedReadOptions

toTemporal() - Method in enum class com.norconex.importer.handler.condition.impl.DateCondition.TimeUnit

toZipFile(CommitterRequest, Path) - Static method in class com.norconex.committer.core.batch.queue.impl.FSQueueUtil

TRACE - Enum constant in enum class com.norconex.committer.core.impl.LogCommitterConfig.LogLevel

track(String) - Method in class com.norconex.crawler.web.fetch.impl.webdriver.HttpSniffer

transform(ChunkedTextSupport, DocHandlerContext, FailableFunction<TextChunk, String, IOException>) - Static method in class com.norconex.importer.util.chunk.ChunkedTextUtil

transform(ChunkedTextSupport, DocHandlerContext, FailableFunction<TextChunk, String, IOException>, Predicate<TextChunk>) - Static method in class com.norconex.importer.util.chunk.ChunkedTextUtil

transformImage(MutableImage) - Method in class com.norconex.importer.handler.transformer.impl.ImageTransformer

TRANSLATED_FROM - Static variable in class com.norconex.importer.doc.DocMetaConstants

Original language when translated.

TranslatorSplitter - Class in com.norconex.importer.handler.splitter.impl

Translate documents using one of the supported translation API.

TranslatorSplitter() - Constructor for class com.norconex.importer.handler.splitter.impl.TranslatorSplitter

Constructor.

TranslatorSplitterConfig - Class in com.norconex.importer.handler.splitter.impl

Translate documents using one of the supported translation API.

TranslatorSplitterConfig() - Constructor for class com.norconex.importer.handler.splitter.impl.TranslatorSplitterConfig

trimAfterSubString(String, String) - Static method in class com.norconex.crawler.web.util.Web

trimAroundSubString(String, String) - Static method in class com.norconex.crawler.web.util.Web

trimBeforeSubString(String, String) - Static method in class com.norconex.crawler.web.util.Web

truncateAt - Static variable in class com.norconex.committer.core.fs.impl.CsvColumn.Fields

truncateAt - Static variable in class com.norconex.committer.core.fs.impl.CsvFileCommitterConfig.Fields

Truncate long values - Search tag in class com.norconex.committer.core.fs.impl.CsvFileCommitter

Section

Truncate long values - Search tag in class com.norconex.committer.core.fs.impl.CsvFileCommitterConfig

Section

TruncateTransformer - Class in com.norconex.importer.handler.transformer.impl

Truncates a fromField value(s) and optionally replace truncated portion by a hash value to help ensure uniqueness (not 100% guaranteed to be collision-free).

TruncateTransformer() - Constructor for class com.norconex.importer.handler.transformer.impl.TruncateTransformer

TruncateTransformerConfig - Class in com.norconex.importer.handler.transformer.impl

Truncates a fromField value(s) and optionally replace truncated portion by a hash value to help ensure uniqueness (not 100% guaranteed to be collision-free).

TruncateTransformerConfig() - Constructor for class com.norconex.importer.handler.transformer.impl.TruncateTransformerConfig

Truncating (or clearing) the document content - Search tag in class com.norconex.importer.handler.transformer.impl.TruncateTransformer

Section

Truncating (or clearing) the document content - Search tag in class com.norconex.importer.handler.transformer.impl.TruncateTransformerConfig

Section

TrustAllX509TrustManager - Class in com.norconex.crawler.web.fetch.util

A very unsafe trust manager accepting ALL certificates.

TrustAllX509TrustManager() - Constructor for class com.norconex.crawler.web.fetch.util.TrustAllX509TrustManager

TUE - Enum constant in enum class com.norconex.crawler.web.doc.operations.delay.impl.DelaySchedule.DOW

TypedJdbcMapStoreFactory - Class in com.norconex.crawler.core.cluster.impl.hazelcast.jdbc

Factory that produces MapStore instances which serialize/deserialize values to/from JSON strings and delegate persistence to StringJdbcMapStore.

TypedJdbcMapStoreFactory() - Constructor for class com.norconex.crawler.core.cluster.impl.hazelcast.jdbc.TypedJdbcMapStoreFactory

TypedJdbcQueueStore<T> - Class in com.norconex.crawler.core.cluster.impl.hazelcast.jdbc

Typed wrapper around StringJdbcQueueStore that serializes objects to JSON strings when storing and deserializes JSON strings when loading.

TypedJdbcQueueStore(HazelcastInstance, String, Properties, Class<T>) - Constructor for class com.norconex.crawler.core.cluster.impl.hazelcast.jdbc.TypedJdbcQueueStore

TypedJdbcQueueStoreFactory - Class in com.norconex.crawler.core.cluster.impl.hazelcast.jdbc

Factory to create a Hazelcast JDBC-backed QueueStore.

TypedJdbcQueueStoreFactory() - Constructor for class com.norconex.crawler.core.cluster.impl.hazelcast.jdbc.TypedJdbcQueueStoreFactory

typeHeader - Static variable in class com.norconex.committer.core.fs.impl.CsvFileCommitterConfig.Fields

Type Name - Search tag in class com.norconex.committer.elasticsearch.ElasticsearchCommitter

Section

Typical usage - Search tag in class com.norconex.crawler.fs.fetch.impl.hdfs.KerberosConfig

Section

Typical usage - Search tag in class com.norconex.crawler.web.fetch.impl.httpclient.KerberosConfig

Section

U

underscore() - Method in class com.norconex.crawler.core.util.StringSanitizer.Builder

UNLIMITED_TITLE_LENGTH - Static variable in class com.norconex.importer.handler.transformer.impl.TitleGeneratorTransformerConfig

UNMODIFIED - Static variable in class com.norconex.crawler.core.ledger.ProcessingOutcome

unregister(CrawlerContext) - Static method in class com.norconex.crawler.core.cluster.pipeline.PipelineProgressJMX

unregister(CrawlerContext) - Static method in class com.norconex.crawler.core.metrics.CrawlerMetricsJMX

UNSECURE_SCHEME - Enum constant in enum class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizerConfig.Normalization

UNSPECIFIED_CRAWL_DELAY - Static variable in class com.norconex.crawler.web.doc.operations.robot.RobotsTxt

unsuccesfulResponseFactory() - Method in class com.norconex.crawler.core.CrawlerDriver.FetchDriver

unsuccesfulResponseFactory(MultiFetcher.UnsuccessfulResponseFactory) - Method in class com.norconex.crawler.core.CrawlerDriver.FetchDriver

unsuccessfulResponseFactory(MultiFetcher.UnsuccessfulResponseFactory) - Method in class com.norconex.crawler.core.fetch.MultiFetcher.Builder

UNSUPPORTED - Static variable in class com.norconex.crawler.core.ledger.ProcessingOutcome

Typically when a reference cannot be processed since it is not supported by the collector or one of its configured component.

UNTRACKED - Enum constant in enum class com.norconex.crawler.core.ledger.ProcessingStatus

Nothing was done with this entry yet.

unwrap() - Method in class com.norconex.crawler.core.cluster.SerializedRecord

Reconstructs the original object instance using the stored className and JSON payload.

UPDATE_TIME - Enum constant in enum class com.norconex.committer.googlecloudsearch.MetadataField

updateCrawlState(CrawlerState) - Method in class com.norconex.crawler.core.session.CrawlerSession

updateCrawlState(CrawlerState) - Method in class com.norconex.crawler.core.session.CrawlerStateStore

Updates the crawl state in the distributed cache with a new timestamp.

updateEntry(CrawlerEntry) - Method in class com.norconex.crawler.core.ledger.CrawlerEntryLedger

Updates an entry in the ledger, maintaining the status counters.

UPPERCASE_ESCAPESEQUENCE - Enum constant in enum class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizerConfig.Normalization

upsert(UpsertRequest) - Method in class com.norconex.committer.core.AbstractCommitter

upsert(UpsertRequest) - Method in interface com.norconex.committer.core.Committer

Updates or inserts the entity represented by the supplied request into the target of this committer.

upsert(T) - Method in class com.norconex.committer.core.service.CommitterService

Updates or inserts an object using all accepting committers.

UpsertRequest - Class in com.norconex.committer.core

A committer upsert request (update or insert).

UpsertRequest(String, Properties, InputStream) - Constructor for class com.norconex.committer.core.UpsertRequest

upsertRequestBuilder(Function<T, UpsertRequest>) - Method in class com.norconex.committer.core.service.CommitterService.CommitterServiceBuilder

uriEncodeLocalPath(String) - Static method in class com.norconex.crawler.fs.fetch.impl.FileFetchUtil

Ensures paths to local files can be converted to valid URIs by properly encoding each path segments.

url - Static variable in class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthConfig.Fields

URL - Enum constant in enum class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig.Storage

Default storages.

URL2PATH - Enum constant in enum class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig.StorageDiskStructure

Create directories for each URL segments, with handling of special characters.

URL2PATH - Enum constant in enum class com.norconex.crawler.web.fetch.util.DocImageHandlerConfig.DirStructure

Create directories for each URL segments, with handling of special characters.

urlConsumer(Consumer<WebCrawlerEntry>) - Method in class com.norconex.crawler.web.doc.operations.sitemap.SitemapContext.SitemapContextBuilder

urlEncode(String) - Static method in class com.norconex.crawler.fs.fetch.impl.FetcherSupport

URL Extraction - Search tag in class com.norconex.crawler.web.WebCrawlerConfig

Section

UrlExtractorTransformer - Class in com.norconex.importer.handler.transformer.impl

Extracts unique URLs matching specific patterns in plain text content and store them in a given field.

UrlExtractorTransformer() - Constructor for class com.norconex.importer.handler.transformer.impl.UrlExtractorTransformer

UrlExtractorTransformerConfig - Class in com.norconex.importer.handler.transformer.impl

Extracts unique URLs matching specific patterns in plain text content and store them in a given field.

UrlExtractorTransformerConfig() - Constructor for class com.norconex.importer.handler.transformer.impl.UrlExtractorTransformerConfig

URL Fragments - Search tag in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractor

Section

URL Normalization - Search tag in class com.norconex.crawler.web.WebCrawlerConfig

Section

urlNormalizers - Static variable in class com.norconex.crawler.web.WebCrawlerConfig.Fields

UrlNormalizerStage - Class in com.norconex.crawler.web.doc.pipelines.queue.stages

UrlNormalizerStage() - Constructor for class com.norconex.crawler.web.doc.pipelines.queue.stages.UrlNormalizerStage

URLS_EXTRACTED - Static variable in class com.norconex.crawler.web.event.WebCrawlerEvent

URLS_POST_IMPORTED - Static variable in class com.norconex.crawler.web.event.WebCrawlerEvent

URL Schemes - Search tag in class com.norconex.crawler.web.doc.operations.link.impl.DomLinkExtractor

Section

URL Schemes - Search tag in class com.norconex.crawler.web.doc.operations.link.impl.HtmlLinkExtractor

Section

UrlScope - Class in com.norconex.crawler.web.doc.operations.scope

urlScopeResolver - Static variable in class com.norconex.crawler.web.WebCrawlerConfig.Fields

UrlScopeResolver - Interface in com.norconex.crawler.web.doc.operations.scope

UrlScopeResolver.SitemapPresence - Enum Class in com.norconex.crawler.web.doc.operations.scope

UrlStatusCrawlerEventListener - Class in com.norconex.crawler.web.event.listeners

Store on file all URLs that were "fetched", along with their HTTP response code.

UrlStatusCrawlerEventListener() - Constructor for class com.norconex.crawler.web.event.listeners.UrlStatusCrawlerEventListener

UrlStatusCrawlerEventListenerConfig - Class in com.norconex.crawler.web.event.listeners

Configuration for UrlStatusCrawlerEventListener.

UrlStatusCrawlerEventListenerConfig() - Constructor for class com.norconex.crawler.web.event.listeners.UrlStatusCrawlerEventListenerConfig

Usage example: - Search tag in class com.norconex.importer.handler.transformer.impl.ImageTransformer

Section

Usage example: - Search tag in class com.norconex.importer.handler.transformer.impl.ImageTransformerConfig

Section

Usage examples: - Search tag in class com.norconex.importer.handler.transformer.impl.ScriptTransformer

Section

Usage examples: - Search tag in class com.norconex.importer.handler.transformer.impl.ScriptTransformerConfig

Section

USER - Enum constant in enum class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.PrincipalType

userAgent(String) - Method in class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetchResponse.HttpClientFetchResponseBuilder

UuidTransformer - Class in com.norconex.importer.handler.transformer.impl

Generates a random Universally unique identifier (UUID) and stores it in the specified field.

UuidTransformer() - Constructor for class com.norconex.importer.handler.transformer.impl.UuidTransformer

UuidTransformerConfig - Class in com.norconex.importer.handler.transformer.impl

Generates a random Universally unique identifier (UUID) and stores it in the specified field.

UuidTransformerConfig() - Constructor for class com.norconex.importer.handler.transformer.impl.UuidTransformerConfig

V

valueOf(String) - Static method in enum class com.norconex.committer.core.batch.queue.impl.FsQueue.SplitBatch

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.norconex.committer.core.fs.impl.CsvFileCommitterConfig.CsvFormat

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.norconex.committer.core.impl.LogCommitterConfig.LogLevel

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.AclInheritanceType

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.AclTarget

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.PrincipalType

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.RequestMode

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.StructuredDataType

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.UploadFormat

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.norconex.committer.googlecloudsearch.MetadataField

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.norconex.committer.solr.SolrClientType

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.norconex.crawler.core.cluster.pipeline.PipelineStatus

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.norconex.crawler.core.cluster.SerializedCache.CacheType

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.norconex.crawler.core.cmd.crawl.pipeline.process.CrawlerProcessStep.ProcessQueueAction

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.norconex.crawler.core.CrawlerConfig.ChangeDiscovery

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.norconex.crawler.core.CrawlerConfig.OrphansStrategy

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.norconex.crawler.core.doc.operations.filter.OnMatch

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.norconex.crawler.core.doc.operations.spoil.SpoiledReferenceStrategy

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.norconex.crawler.core.event.listeners.StopCrawlerOnMaxEventListenerConfig.OnMultiple

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.norconex.crawler.core.fetch.FetchDirective

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.norconex.crawler.core.fetch.FetchDirectiveSupport

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in class com.norconex.crawler.core.ledger.ProcessingOutcome

valueOf(String) - Static method in enum class com.norconex.crawler.core.ledger.ProcessingStatus

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.norconex.crawler.core.session.CrawlerMode

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.norconex.crawler.core.session.CrawlerResumeState

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.norconex.crawler.core.session.CrawlerState

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.norconex.crawler.fs.fetch.impl.FolderItemReferenceParser.Kind

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.norconex.crawler.fs.fetch.impl.googledrive.GoogleDriveFetcherConfig.NativeDocumentFormatPolicy

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.norconex.crawler.fs.fetch.impl.hdfs.HdfsAuthMethod

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.norconex.crawler.fs.fetch.impl.m365graph.M365GraphFetcherConfig.SourceDeltaExpansion

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.norconex.crawler.web.doc.operations.delay.impl.BaseDelayResolverConfig.DelayResolverScope

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.norconex.crawler.web.doc.operations.delay.impl.DelaySchedule.DOW

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig.Quality

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig.Storage

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig.StorageDiskStructure

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.norconex.crawler.web.doc.operations.recrawl.impl.GenericRecrawlableResolverConfig.MinFrequency.ApplyTo

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.norconex.crawler.web.doc.operations.recrawl.impl.GenericRecrawlableResolverConfig.SitemapSupport

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.norconex.crawler.web.doc.operations.scope.UrlScopeResolver.SitemapPresence

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.norconex.crawler.web.doc.operations.sitemap.SitemapChangeFrequency

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizerConfig.Normalization

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.norconex.crawler.web.fetch.HttpMethod

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthMethod

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig.CookieSpec

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightBrowser

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcherConfig.WaitElementType

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverBrowser

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig.WaitElementType

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.norconex.crawler.web.fetch.util.DocImageHandlerConfig.DirStructure

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.norconex.crawler.web.fetch.util.DocImageHandlerConfig.Target

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.norconex.crawler.web.WebCrawlerConfig.ReferencedLinkType

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.norconex.importer.handler.condition.impl.DateCondition.TimeUnit

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.norconex.importer.handler.parser.ParseState

Returns the enum constant of this class with the specified name.

valueOf(String) - Static method in enum class com.norconex.importer.response.ImporterResponse.Status

Returns the enum constant of this class with the specified name.

values() - Static method in enum class com.norconex.committer.core.batch.queue.impl.FsQueue.SplitBatch

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.norconex.committer.core.fs.impl.CsvFileCommitterConfig.CsvFormat

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.norconex.committer.core.impl.LogCommitterConfig.LogLevel

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.AclInheritanceType

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.AclTarget

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.PrincipalType

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.RequestMode

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.StructuredDataType

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.norconex.committer.googlecloudsearch.GoogleCloudSearchCommitterConfig.UploadFormat

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.norconex.committer.googlecloudsearch.MetadataField

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.norconex.committer.solr.SolrClientType

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.norconex.crawler.core.cluster.pipeline.PipelineStatus

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.norconex.crawler.core.cluster.SerializedCache.CacheType

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.norconex.crawler.core.cmd.crawl.pipeline.process.CrawlerProcessStep.ProcessQueueAction

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.norconex.crawler.core.CrawlerConfig.ChangeDiscovery

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.norconex.crawler.core.CrawlerConfig.OrphansStrategy

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.norconex.crawler.core.doc.operations.filter.OnMatch

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.norconex.crawler.core.doc.operations.spoil.SpoiledReferenceStrategy

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.norconex.crawler.core.event.listeners.StopCrawlerOnMaxEventListenerConfig.OnMultiple

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.norconex.crawler.core.fetch.FetchDirective

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.norconex.crawler.core.fetch.FetchDirectiveSupport

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.norconex.crawler.core.ledger.ProcessingStatus

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.norconex.crawler.core.session.CrawlerMode

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.norconex.crawler.core.session.CrawlerResumeState

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.norconex.crawler.core.session.CrawlerState

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.norconex.crawler.fs.fetch.impl.FolderItemReferenceParser.Kind

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.norconex.crawler.fs.fetch.impl.googledrive.GoogleDriveFetcherConfig.NativeDocumentFormatPolicy

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.norconex.crawler.fs.fetch.impl.hdfs.HdfsAuthMethod

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.norconex.crawler.fs.fetch.impl.m365graph.M365GraphFetcherConfig.SourceDeltaExpansion

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.norconex.crawler.web.doc.operations.delay.impl.BaseDelayResolverConfig.DelayResolverScope

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.norconex.crawler.web.doc.operations.delay.impl.DelaySchedule.DOW

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig.Quality

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig.Storage

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.norconex.crawler.web.doc.operations.image.impl.FeaturedImageResolverConfig.StorageDiskStructure

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.norconex.crawler.web.doc.operations.recrawl.impl.GenericRecrawlableResolverConfig.MinFrequency.ApplyTo

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.norconex.crawler.web.doc.operations.recrawl.impl.GenericRecrawlableResolverConfig.SitemapSupport

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.norconex.crawler.web.doc.operations.scope.UrlScopeResolver.SitemapPresence

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.norconex.crawler.web.doc.operations.sitemap.SitemapChangeFrequency

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.norconex.crawler.web.doc.operations.url.impl.GenericUrlNormalizerConfig.Normalization

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.norconex.crawler.web.fetch.HttpMethod

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthMethod

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.norconex.crawler.web.fetch.impl.httpclient.HttpClientFetcherConfig.CookieSpec

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightBrowser

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcherConfig.WaitElementType

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverBrowser

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig.WaitElementType

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.norconex.crawler.web.fetch.util.DocImageHandlerConfig.DirStructure

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.norconex.crawler.web.fetch.util.DocImageHandlerConfig.Target

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.norconex.crawler.web.WebCrawlerConfig.ReferencedLinkType

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.norconex.importer.handler.condition.impl.DateCondition.TimeUnit

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.norconex.importer.handler.parser.ParseState

Returns an array containing the constants of this enum class, in the order they are declared.

values() - Static method in enum class com.norconex.importer.response.ImporterResponse.Status

Returns an array containing the constants of this enum class, in the order they are declared.

VELOCITY_ENGINE - Static variable in class com.norconex.importer.handler.ScriptRunner

vendor() - Method in interface com.norconex.crawler.core.cluster.CacheManager

Gets the vendor-specific implementation object.

vendor() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastCacheManager

vendor() - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastMapAdapter

Return the underlying Hazelcast IMap as typed view.

vendor() - Method in class com.norconex.crawler.core.cluster.impl.memory.MemoryCacheManager

vendor() - Method in class com.norconex.crawler.core.cluster.impl.mvstore.MVStoreCacheManager

W

waitForClusterWarmUp(HazelcastCluster) - Static method in class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastUtil

waitUntil(BooleanSupplier) - Static method in class com.norconex.crawler.core.util.ConcurrentUtil

In some cases we do not want to block any thread when waiting for a future completion.

waitUntil(BooleanSupplier, Duration) - Static method in class com.norconex.crawler.core.util.ConcurrentUtil

In some cases we do not want to block any thread when waiting for a future completion.

waitUntil(BooleanSupplier, Duration, Duration) - Static method in class com.norconex.crawler.core.util.ConcurrentUtil

In some cases we do not want to block any thread when waiting for a future completion.

waitUntilOrThrow(BooleanSupplier, Duration) - Static method in class com.norconex.crawler.core.util.ConcurrentUtil

In some cases we do not want to block any thread when waiting for a future completion.

waitUntilOrThrow(BooleanSupplier, Duration, Duration) - Static method in class com.norconex.crawler.core.util.ConcurrentUtil

In some cases we do not want to block any thread when waiting for a future completion.

WARN - Enum constant in enum class com.norconex.committer.core.impl.LogCommitterConfig.LogLevel

Web - Class in com.norconex.crawler.web.util

WebCrawler - Class in com.norconex.crawler.web

Facade for launching or obtaining a Web Crawler.

WebCrawlerCallbacks - Class in com.norconex.crawler.web.callbacks

WebCrawlerConfig - Class in com.norconex.crawler.web

Web Crawler configuration, adding more options to the base CrawlerConfig.

WebCrawlerConfig() - Constructor for class com.norconex.crawler.web.WebCrawlerConfig

WebCrawlerConfig.Fields - Class in com.norconex.crawler.web

WebCrawlerConfig.ReferencedLinkType - Enum Class in com.norconex.crawler.web

Flags for storing as metadata a page referenced links.

WebCrawlerDriverFactory - Class in com.norconex.crawler.web

WebCrawlerDriverFactory() - Constructor for class com.norconex.crawler.web.WebCrawlerDriverFactory

WebCrawlerEntry - Class in com.norconex.crawler.web.ledger

A URL being crawled holding relevant crawl information.

WebCrawlerEntry() - Constructor for class com.norconex.crawler.web.ledger.WebCrawlerEntry

WebCrawlerEntry(WebCrawlerEntry) - Constructor for class com.norconex.crawler.web.ledger.WebCrawlerEntry

Copy constructor.

WebCrawlerEntry(String) - Constructor for class com.norconex.crawler.web.ledger.WebCrawlerEntry

WebCrawlerEntry(String, int) - Constructor for class com.norconex.crawler.web.ledger.WebCrawlerEntry

Constructor.

WebCrawlerEvent - Class in com.norconex.crawler.web.event

HTTP Crawler event names.

WebDavFetcher - Class in com.norconex.crawler.fs.fetch.impl.webdav

Fetcher for WebDAV repositories (webdav://, webdavs://), backed by a custom, read-only NIO.2 FileSystemProvider (WebDavFileSystemProvider) that speaks WebDAV directly over Apache HttpClient (no third-party WebDAV library).

WebDavFetcher() - Constructor for class com.norconex.crawler.fs.fetch.impl.webdav.WebDavFetcher

WebDavFetcherConfig - Class in com.norconex.crawler.fs.fetch.impl.webdav

Configuration for WebDavFetcher.

WebDavFetcherConfig() - Constructor for class com.norconex.crawler.fs.fetch.impl.webdav.WebDavFetcherConfig

WebDocMetadata - Class in com.norconex.crawler.web.doc

Metadata constants for common metadata field names typically set by the Web Crawler crawler.

WebDocPipelines - Class in com.norconex.crawler.web.doc.pipelines

WebDriverBrowser - Enum Class in com.norconex.crawler.web.fetch.impl.webdriver

A web browser.

WebDriverBrowser.CustomDriverOptions - Class in com.norconex.crawler.web.fetch.impl.webdriver

WebDriverFactory - Class in com.norconex.crawler.web.fetch.impl.webdriver

WebDriverFetcher - Class in com.norconex.crawler.web.fetch.impl.webdriver

Uses Selenium WebDriver support for using native browsers to crawl documents.

WebDriverFetcher() - Constructor for class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcher

WebDriverFetcherConfig - Class in com.norconex.crawler.web.fetch.impl.webdriver

Configuration for WebDriverFetcher.

WebDriverFetcherConfig() - Constructor for class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig

WebDriverFetcherConfig.WaitElementType - Enum Class in com.norconex.crawler.web.fetch.impl.webdriver

WebDriverManager - Class in com.norconex.crawler.web.fetch.impl.webdriver

WebDriverManager(WebDriverFetcherConfig) - Constructor for class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverManager

WebDriverScreenshotHandler - Class in com.norconex.crawler.web.fetch.impl.webdriver

Takes screenshot of pages using a Selenium WebDriver.

WebDriverScreenshotHandler() - Constructor for class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverScreenshotHandler

WebDriverScreenshotHandler(CachedStreamFactory) - Constructor for class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverScreenshotHandler

WebFetchRequest - Class in com.norconex.crawler.web.fetch

HTTP Fetch request.

WebFetchRequest(Doc, HttpMethod) - Constructor for class com.norconex.crawler.web.fetch.WebFetchRequest

WebFetchResponse - Interface in com.norconex.crawler.web.fetch

HTTP response information obtained from fetching a document.

WebImporterPipelineContext - Class in com.norconex.crawler.web.doc.pipelines.importer

WebImporterPipelineContext(ImporterPipelineContext) - Constructor for class com.norconex.crawler.web.doc.pipelines.importer.WebImporterPipelineContext

Constructor creating a copy of supplied context.

WebImporterPipelineContext(CrawlerSession, CrawlerDocContext) - Constructor for class com.norconex.crawler.web.doc.pipelines.importer.WebImporterPipelineContext

WebImporterPipelineUtil - Class in com.norconex.crawler.web.doc.pipelines.importer

WEBKIT - Enum constant in enum class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightBrowser

WebKit-based browser (also used by Apple Safari).

WebProcessingOutcome - Class in com.norconex.crawler.web.doc

Represents a URL crawling status.

WebProcessingOutcome(String) - Constructor for class com.norconex.crawler.web.doc.WebProcessingOutcome

WebUrlNormalizer - Interface in com.norconex.crawler.web.doc.operations.url

Responsible for normalizing URLs.

WED - Enum constant in enum class com.norconex.crawler.web.doc.operations.delay.impl.DelaySchedule.DOW

WEEKLY - Enum constant in enum class com.norconex.crawler.web.doc.operations.sitemap.SitemapChangeFrequency

withAutoShutdown(CompletableFuture<T>, ExecutorService) - Static method in class com.norconex.crawler.core.util.ConcurrentUtil

withCrawlSession(Consumer<CrawlerSession>) - Method in class com.norconex.crawler.core.Crawler

withEventManager(EventManager) - Method in class com.norconex.committer.core.CommitterContext

withLocation(String) - Method in class com.norconex.crawler.web.doc.operations.sitemap.SitemapContext

withReference(String) - Method in class com.norconex.crawler.core.ledger.CrawlerEntry

withReference(String) - Method in class com.norconex.importer.doc.Doc

withScript(String) - Method in class com.norconex.importer.handler.ScriptRunner

withStreamFactory(CachedStreamFactory) - Method in class com.norconex.committer.core.CommitterContext

withWorkdir(Path) - Method in class com.norconex.committer.core.CommitterContext

workDir - Static variable in class com.norconex.crawler.core.CrawlerConfig.Fields

workDir() - Method in record class com.norconex.crawler.core.cluster.impl.hazelcast.HazelcastConfigurerContext

Returns the value of the workDir record component.

workDir(Path) - Method in class com.norconex.crawler.core.context.CrawlerContext.Builder

workstation - Static variable in class com.norconex.crawler.web.fetch.impl.httpclient.HttpAuthConfig.Fields

wrap(Object) - Static method in class com.norconex.crawler.core.cluster.SerializedRecord

Creates an envelope for the given object.

wrapAsCompletionException(Exception) - Static method in class com.norconex.crawler.core.util.ConcurrentUtil

Wraps InterruptedException, TimeoutException, ExecutionException root cause, and any other checked exceptions in a runtime CompletionException.

write(CompactWriter, StepRecord) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.StepRecordCompactSerializer

write(CompactWriter, T) - Method in class com.norconex.crawler.core.cluster.impl.hazelcast.JacksonCompactSerializer

WriteAdapter - Class in com.norconex.importer.util

WriteAdapter(OutputStream) - Constructor for class com.norconex.importer.util.WriteAdapter

WriteAdapter(Supplier<OutputStream>) - Constructor for class com.norconex.importer.util.WriteAdapter

WriteAdapter(Supplier<OutputStream>, Charset) - Constructor for class com.norconex.importer.util.WriteAdapter

writeBack(DocHandlerContext, TextChunk, String) - Static method in class com.norconex.importer.util.chunk.ChunkedTextUtil

writeDelete(EnhancedXmlStreamWriter, DeleteRequest) - Method in class com.norconex.committer.core.fs.impl.XmlFileCommitter

writeDelete(Writer, DeleteRequest) - Method in class com.norconex.committer.core.fs.impl.JsonFileCommitter

writeDelete(CSVPrinter, DeleteRequest) - Method in class com.norconex.committer.core.fs.impl.CsvFileCommitter

writeDelete(T, DeleteRequest) - Method in class com.norconex.committer.core.fs.AbstractFsCommitter

writeUpsert(EnhancedXmlStreamWriter, UpsertRequest) - Method in class com.norconex.committer.core.fs.impl.XmlFileCommitter

writeUpsert(Writer, UpsertRequest) - Method in class com.norconex.committer.core.fs.impl.JsonFileCommitter

writeUpsert(CSVPrinter, UpsertRequest) - Method in class com.norconex.committer.core.fs.impl.CsvFileCommitter

writeUpsert(T, UpsertRequest) - Method in class com.norconex.committer.core.fs.AbstractFsCommitter

X

XfdlTikaParser - Class in com.norconex.importer.handler.parser.impl

Parser for PureEdge Extensible Forms Description Language (XFDL).

XfdlTikaParser() - Constructor for class com.norconex.importer.handler.parser.impl.XfdlTikaParser

XML_BASE_CONTENT_TYPES - Static variable in class com.norconex.importer.handler.CommonMatchers

Base content types for XML: "application/xml" and "text/xml".

XML_CONTENT_TYPES - Static variable in class com.norconex.importer.handler.CommonMatchers

HTML, XHTML, and XML-based content types:

XML_FEED_CONTENT_TYPES - Static variable in class com.norconex.importer.handler.CommonMatchers

ATOM, RDF, RSS, and strict XML content types:

xmlContentTypes() - Static method in class com.norconex.importer.handler.CommonMatchers

Common content-types defining an XML document.

xmlContentTypes(String) - Static method in class com.norconex.importer.handler.CommonRestrictions

Common content-types defining an XML document.

xmlFeedContentTypes() - Static method in class com.norconex.importer.handler.CommonMatchers

Matcher for common content-types defining an XML feed (RSS, Atom).

xmlFeedContentTypes(String) - Static method in class com.norconex.importer.handler.CommonRestrictions

Common content-types defining an XML feed (RSS, Atom).

XmlFeedLinkExtractor - Class in com.norconex.crawler.web.doc.operations.link.impl

Link extractor for extracting links out of RSS and Atom XML feeds.

XmlFeedLinkExtractor() - Constructor for class com.norconex.crawler.web.doc.operations.link.impl.XmlFeedLinkExtractor

XmlFeedLinkExtractorConfig - Class in com.norconex.crawler.web.doc.operations.link.impl

Configuration for XmlFeedLinkExtractor.

XmlFeedLinkExtractorConfig() - Constructor for class com.norconex.crawler.web.doc.operations.link.impl.XmlFeedLinkExtractorConfig

XmlFileCommitter - Class in com.norconex.committer.core.fs.impl

Commits documents to XML files.

XmlFileCommitter() - Constructor for class com.norconex.committer.core.fs.impl.XmlFileCommitter

XmlFileCommitterConfig - Class in com.norconex.committer.core.fs.impl

Configuration for the XmlFileCommitter.

XmlFileCommitterConfig() - Constructor for class com.norconex.committer.core.fs.impl.XmlFileCommitterConfig

XmlFileCommitterConfig.Fields - Class in com.norconex.committer.core.fs.impl

XmlStreamSplitter - Class in com.norconex.importer.handler.splitter.impl

Splits XML document on a specific element.

XmlStreamSplitter() - Constructor for class com.norconex.importer.handler.splitter.impl.XmlStreamSplitter

XmlStreamSplitterConfig - Class in com.norconex.importer.handler.splitter.impl

Splits XML document on a specific element.

XmlStreamSplitterConfig() - Constructor for class com.norconex.importer.handler.splitter.impl.XmlStreamSplitterConfig

XML vs HTML - Search tag in class com.norconex.importer.handler.condition.impl.DomCondition

Section

XML vs HTML - Search tag in class com.norconex.importer.handler.condition.impl.DomConditionConfig

Section

XPATH - Enum constant in enum class com.norconex.crawler.web.fetch.impl.playwright.PlaywrightFetcherConfig.WaitElementType

Locate by XPath expression.

XPATH - Enum constant in enum class com.norconex.crawler.web.fetch.impl.webdriver.WebDriverFetcherConfig.WaitElementType

Y

YEAR - Enum constant in enum class com.norconex.importer.handler.condition.impl.DateCondition.TimeUnit

YEARLY - Enum constant in enum class com.norconex.crawler.web.doc.operations.sitemap.SitemapChangeFrequency

_

"_id" field - Search tag in class com.norconex.committer.elasticsearch.ElasticsearchCommitter

Section

A B C D E F G H I J K L M N O P Q R S T U V W X Y _
All Classes and Interfaces|All Packages|Constant Field Values|Serialized Form