Package com.norconex.crawler.core.ledger

Class CrawlerEntry

java.lang.Object
com.norconex.crawler.core.ledger.CrawlerEntry
All Implemented Interfaces:
Serializable
Direct Known Subclasses:
FsCrawlerEntry, WebCrawlerEntry
public class CrawlerEntry extends Object implements Serializable
Holds minimal meta information and state necessary to the proper (re)processing of a document in the context of a crawl. Also persisted in the CrawlerEntryLedger.
See Also:

  • Constructor Details

    • CrawlerEntry

      public CrawlerEntry()

    • CrawlerEntry

      public CrawlerEntry(String reference)

  • Method Details

    • withReference

      public CrawlerEntry withReference(String reference)

    • getReferenceTrail

      public List<String> getReferenceTrail()
      Gets original references before normalization, redirect, etc.
      Returns:
      reference trail up to, but excluding, the current one.

    • setReferenceTrail

      public void setReferenceTrail(List<String> referenceTrail)
      Sets original references before normalization, redirect, etc.
      Parameters:
      referenceTrail - reference trail up to, but excluding, the current one.

    • addToReferenceTrail

      public void addToReferenceTrail(String reference)
      Adds original references before normalization, redirect, etc.
      Parameters:
      reference - reference to append to the trail

    • getMetaChecksum

      public String getMetaChecksum()

    • setMetaChecksum

      public void setMetaChecksum(String metaChecksum)

    • getContentChecksum

      public String getContentChecksum()
      Gets the content checksum.
      Returns:
      the content checksum

    • setContentChecksum

      public void setContentChecksum(String contentChecksum)
      Sets the content checksum.
      Parameters:
      contentChecksum - content checksum

    • getQueuedAt

      public ZonedDateTime getQueuedAt()
      Gets the queued date.
      Returns:
      the queued date

    • setQueuedAt

      public void setQueuedAt(ZonedDateTime queuedAt)
      Sets the queued date.
      Parameters:
      queuedAt - the queued date

    • getDepth

      public int getDepth()
      Typically, the number of "hops" or directories to get to a file.

    • getProcessingStatus

      @NonNull public @NonNull ProcessingStatus getProcessingStatus()

    • getProcessingOutcome

      public ProcessingOutcome getProcessingOutcome()

    • getProcessingAt

      public ZonedDateTime getProcessingAt()

    • getProcessedAt

      public ZonedDateTime getProcessedAt()

    • getLastModified

      public ZonedDateTime getLastModified()

    • getContentType

      public ContentType getContentType()

    • getCharset

      public Charset getCharset()

    • isOrphan

      public boolean isOrphan()

    • isDeleted

      public boolean isDeleted()

    • getReference

      public String getReference()

    • setDepth

      public void setDepth(int depth)
      Typically, the number of "hops" or directories to get to a file.

    • setProcessingStatus

      public void setProcessingStatus(@NonNull @NonNull ProcessingStatus processingStatus)

    • setProcessingOutcome

      public void setProcessingOutcome(ProcessingOutcome processingOutcome)

    • setProcessingAt

      public void setProcessingAt(ZonedDateTime processingAt)

    • setProcessedAt

      public void setProcessedAt(ZonedDateTime processedAt)

    • setLastModified

      public void setLastModified(ZonedDateTime lastModified)

    • setContentType

      public void setContentType(ContentType contentType)

    • setCharset

      public void setCharset(Charset charset)

    • setOrphan

      public void setOrphan(boolean orphan)

    • setDeleted

      public void setDeleted(boolean deleted)

    • setReference

      public void setReference(String reference)

    • equals

      public boolean equals(Object o)
      Overrides:
      equals in class Object

    • canEqual

      protected boolean canEqual(Object other)

    • hashCode

      public int hashCode()
      Overrides:
      hashCode in class Object

    • toString

      public String toString()
      Overrides:
      toString in class Object