Package com.norconex.committer.core.batch.queue.impl

Class FsQueueConfig

java.lang.Object
com.norconex.committer.core.batch.queue.impl.FsQueueConfig
public class FsQueueConfig extends Object

  • Field Details

  • Constructor Details

    • FsQueueConfig

      public FsQueueConfig()

  • Method Details

    • getBatchSize

      public int getBatchSize()
      The number of documents to be queued in a batch on disk before consuming that batch. Default is 20.

    • getMaxPerFolder

      public int getMaxPerFolder()
      The maximum number of files to be queued on disk in a given folders. A batch size can sometimes be too big for some file systems to handle efficiently. Having this number lower than the batch size allows to have large batches without having too many files in a single directory. Default is 500.

    • isCommitLeftoversOnInit

      public boolean isCommitLeftoversOnInit()
      During initialization, whether to attempt committing any leftover files in the committer queue from a previous crawl session. Leftovers are typically associated with an abnormal termination (E.g., prematurely ended).

    • getOnCommitFailure

      public FsQueueConfig.OnCommitFailure getOnCommitFailure()
      Establishes how to handle commit failures.

    • setBatchSize

      public FsQueueConfig setBatchSize(int batchSize)
      The number of documents to be queued in a batch on disk before consuming that batch. Default is 20.
      Returns:
      this.

    • setMaxPerFolder

      public FsQueueConfig setMaxPerFolder(int maxPerFolder)
      The maximum number of files to be queued on disk in a given folders. A batch size can sometimes be too big for some file systems to handle efficiently. Having this number lower than the batch size allows to have large batches without having too many files in a single directory. Default is 500.
      Returns:
      this.

    • setCommitLeftoversOnInit

      public FsQueueConfig setCommitLeftoversOnInit(boolean commitLeftoversOnInit)
      During initialization, whether to attempt committing any leftover files in the committer queue from a previous crawl session. Leftovers are typically associated with an abnormal termination (E.g., prematurely ended).
      Returns:
      this.

    • equals

      public boolean equals(Object o)
      Overrides:
      equals in class Object

    • canEqual

      protected boolean canEqual(Object other)

    • hashCode

      public int hashCode()
      Overrides:
      hashCode in class Object

    • toString

      public String toString()
      Overrides:
      toString in class Object