StorageDiskStructure

Supported on-disk directory structure layouts for the storage engine.

crawler/webJavadoc: StorageDiskStructure

Notes

Controls how the storage engine organizes data on disk. Different layouts (e.g., flat, date-based, or hash-partitioned) affect file distribution, lookup performance, and how stored data is navigated or archived.

Usage

YAML

StorageDiskStructure: URL2PATH

JSON

{
  "StorageDiskStructure": "URL2PATH"
}

XML

<storageDiskStructure/>

Allowed Values

• URL2PATH
• DATE
• DATETIME