Uses of Class
com.norconex.crawler.core.fetch.AbstractFetcher

Packages that use AbstractFetcher

Package	Description
com.norconex.crawler.fs.fetch.impl
com.norconex.crawler.fs.fetch.impl.adlsgen2
com.norconex.crawler.fs.fetch.impl.archive
com.norconex.crawler.fs.fetch.impl.azureblob
com.norconex.crawler.fs.fetch.impl.box
com.norconex.crawler.fs.fetch.impl.cmis
com.norconex.crawler.fs.fetch.impl.egnyte
com.norconex.crawler.fs.fetch.impl.ftp
com.norconex.crawler.fs.fetch.impl.gcs
com.norconex.crawler.fs.fetch.impl.googledrive
com.norconex.crawler.fs.fetch.impl.hdfs
com.norconex.crawler.fs.fetch.impl.local
com.norconex.crawler.fs.fetch.impl.m365graph
com.norconex.crawler.fs.fetch.impl.s3
com.norconex.crawler.fs.fetch.impl.sftp
com.norconex.crawler.fs.fetch.impl.smb
com.norconex.crawler.fs.fetch.impl.webdav
com.norconex.crawler.web.fetch.impl.httpclient
com.norconex.crawler.web.fetch.impl.playwright
com.norconex.crawler.web.fetch.impl.webdriver

Uses of AbstractFetcher in com.norconex.crawler.fs.fetch.impl

Subclasses of AbstractFetcher in com.norconex.crawler.fs.fetch.impl

Modifier and Type	Class	Description
class	AbstractNioFetcher<C extends BaseFetcherConfig>	Base class for fetchers relying on Java NIO.2 (java.nio.file), either via the JDK's built-in providers or third-party FileSystemProvider implementations found on the classpath.

Uses of AbstractFetcher in com.norconex.crawler.fs.fetch.impl.adlsgen2

Subclasses of AbstractFetcher in com.norconex.crawler.fs.fetch.impl.adlsgen2

Modifier and Type	Class	Description
class	AdlsGen2Fetcher	Fetcher for Azure Data Lake Storage Gen2, using references such as abfss://filesystem@account.dfs.core.windows.net/path/to/file.

Uses of AbstractFetcher in com.norconex.crawler.fs.fetch.impl.archive

Subclasses of AbstractFetcher in com.norconex.crawler.fs.fetch.impl.archive

Modifier and Type	Class	Description
class	ArchiveFetcher	Fetcher for archive file systems treated as virtual directory trees.

Uses of AbstractFetcher in com.norconex.crawler.fs.fetch.impl.azureblob

Subclasses of AbstractFetcher in com.norconex.crawler.fs.fetch.impl.azureblob

Modifier and Type	Class	Description
class	AzureBlobFetcher	Fetcher for Azure Blob Storage, using references such as azblob://account/container/path/to/blob.

Uses of AbstractFetcher in com.norconex.crawler.fs.fetch.impl.box

Subclasses of AbstractFetcher in com.norconex.crawler.fs.fetch.impl.box

Modifier and Type	Class	Description
class	BoxFetcher	Box API fetcher.

Uses of AbstractFetcher in com.norconex.crawler.fs.fetch.impl.cmis

Subclasses of AbstractFetcher in com.norconex.crawler.fs.fetch.impl.cmis

Modifier and Type	Class	Description
class	CmisFetcher	CMIS-enabled Content Management Systems (CMS) fetcher (Atom end-point), backed by a custom, read-only NIO.2 FileSystemProvider (CmisFileSystemProvider).

Uses of AbstractFetcher in com.norconex.crawler.fs.fetch.impl.egnyte

Subclasses of AbstractFetcher in com.norconex.crawler.fs.fetch.impl.egnyte

Modifier and Type	Class	Description
class	EgnyteFetcher	Egnyte API fetcher.

Uses of AbstractFetcher in com.norconex.crawler.fs.fetch.impl.ftp

Subclasses of AbstractFetcher in com.norconex.crawler.fs.fetch.impl.ftp

Modifier and Type	Class	Description
class	FtpFetcher	FTP (ftp://) and FTPS (ftps://) fetcher, backed by the ftp-fs NIO.2 file system provider.

Uses of AbstractFetcher in com.norconex.crawler.fs.fetch.impl.gcs

Subclasses of AbstractFetcher in com.norconex.crawler.fs.fetch.impl.gcs

Modifier and Type	Class	Description
class	GcsFetcher	Fetcher for Google Cloud Storage (gs://bucket/object), backed by the official Google-maintained google-cloud-nio provider.

Uses of AbstractFetcher in com.norconex.crawler.fs.fetch.impl.googledrive

Subclasses of AbstractFetcher in com.norconex.crawler.fs.fetch.impl.googledrive

Modifier and Type	Class	Description
class	GoogleDriveFetcher	Google Drive API fetcher for Google Workspace My Drive and Shared Drives.

Uses of AbstractFetcher in com.norconex.crawler.fs.fetch.impl.hdfs

Subclasses of AbstractFetcher in com.norconex.crawler.fs.fetch.impl.hdfs

Modifier and Type	Class	Description
class	HdfsFetcher	Fetcher for HDFS (webhdfs://), backed by a custom, read-only NIO.2 FileSystemProvider (HdfsFileSystemProvider) that speaks the WebHDFS REST API directly over Apache HttpClient - no Hadoop client dependency.

Uses of AbstractFetcher in com.norconex.crawler.fs.fetch.impl.local

Subclasses of AbstractFetcher in com.norconex.crawler.fs.fetch.impl.local

Modifier and Type	Class	Description
class	LocalFetcher	Fetcher for a local file system, backed by the JDK's default FileSystemProvider.

Uses of AbstractFetcher in com.norconex.crawler.fs.fetch.impl.m365graph

Subclasses of AbstractFetcher in com.norconex.crawler.fs.fetch.impl.m365graph

Modifier and Type	Class	Description
class	M365GraphFetcher	Microsoft 365 Graph fetcher for SharePoint Online and OneDrive.

Uses of AbstractFetcher in com.norconex.crawler.fs.fetch.impl.s3

Subclasses of AbstractFetcher in com.norconex.crawler.fs.fetch.impl.s3

Modifier and Type	Class	Description
class	S3Fetcher	Fetcher for Amazon S3 (s3://bucket/key), backed by a custom, read-only NIO.2 FileSystemProvider (S3FileSystemProvider) built directly on the standard AWS SDK v2 S3Client - not the AWS Common Runtime (CRT) client, avoiding its ~19MB native-library dependency.

Uses of AbstractFetcher in com.norconex.crawler.fs.fetch.impl.sftp

Subclasses of AbstractFetcher in com.norconex.crawler.fs.fetch.impl.sftp

Modifier and Type	Class	Description
class	SftpFetcher	SFTP fetcher (sftp://), backed by the sftp-fs NIO.2 file system provider.

Uses of AbstractFetcher in com.norconex.crawler.fs.fetch.impl.smb

Subclasses of AbstractFetcher in com.norconex.crawler.fs.fetch.impl.smb

Modifier and Type	Class	Description
class	SmbFetcher	CIFS fetcher (Samba, Windows share) (smb://), backed by a custom, read-only NIO.2 FileSystemProvider (SmbFileSystemProvider) built directly on jcifs-ng's classic SmbFile API.

Uses of AbstractFetcher in com.norconex.crawler.fs.fetch.impl.webdav

Subclasses of AbstractFetcher in com.norconex.crawler.fs.fetch.impl.webdav

Modifier and Type	Class	Description
class	WebDavFetcher	Fetcher for WebDAV repositories (webdav://, webdavs://), backed by a custom, read-only NIO.2 FileSystemProvider (WebDavFileSystemProvider) that speaks WebDAV directly over Apache HttpClient (no third-party WebDAV library).

Uses of AbstractFetcher in com.norconex.crawler.web.fetch.impl.httpclient

Subclasses of AbstractFetcher in com.norconex.crawler.web.fetch.impl.httpclient

Modifier and Type	Class	Description
class	HttpClientFetcher	Default web crawler implementation of Fetcher, based on Apache HttpClient.

Uses of AbstractFetcher in com.norconex.crawler.web.fetch.impl.playwright

Subclasses of AbstractFetcher in com.norconex.crawler.web.fetch.impl.playwright

Modifier and Type	Class	Description
class	PlaywrightFetcher	Uses Microsoft Playwright for browser-based crawling.

Uses of AbstractFetcher in com.norconex.crawler.web.fetch.impl.webdriver

Subclasses of AbstractFetcher in com.norconex.crawler.web.fetch.impl.webdriver

Modifier and Type	Class	Description
class	WebDriverFetcher	Uses Selenium WebDriver support for using native browsers to crawl documents.