DirStructure

Defines the directory structure convention used for on-disk storage.

crawler/webJavadoc: DirStructure

Notes

Controls how files are organized into subdirectories on disk. Different structures (e.g., date-based, hash-based) affect how documents and their metadata are laid out in the file system for storage and retrieval.

Usage

YAML

DirStructure: URL2PATH

JSON

{
  "DirStructure": "URL2PATH"
}

XML

<dirStructure/>

Allowed Values

• URL2PATH
• DATE
• DATETIME