Skip to main content

Fetcher

Supported implementations for Fetcher.

crawler/coreJavadoc: Fetcher

Notes

Retrieves documents and their metadata from the source being crawled. Select one of the supported fetcher implementations to configure how the crawler accesses content.

Built-in baseline, not a hard limit

The fetcher implementations documented here are built-in defaults. They are not a fixed ceiling. Teams can extend crawler behavior with custom fetchers and related pipeline components for customer-specific source requirements.

Implementations