Storage

Supported storage backend types for the crawler data store.

crawler/webJavadoc: Storage

Notes

Specifies the storage engine used to persist crawler state such as the crawl queue, processed references, and cached data. The selected storage type determines where and how crawl state is maintained between sessions.

Usage

YAML

Storage: URL

JSON

{
  "Storage": "URL"
}

XML

<storage/>

Allowed Values

• URL
• INLINE
• DISK