Package com.norconex.crawler.core.doc

Class CrawlerDocMetaConstants

java.lang.Object

com.norconex.crawler.core.doc.CrawlerDocMetaConstants

public final class CrawlerDocMetaConstants
extends Object

Metadata constants for common metadata field names typically set by a collector crawler.

See Also:

• DocMetaConstants

Field Summary

Fields

Modifier and Type	Field	Description
static final String	CHECKSUM_DOC
static final String	CHECKSUM_METADATA
static final String	DEPTH
static final String	FETCHER	Qualified name of fetcher used to fetch a document.
static final String	IS_DOC_NEW	Boolean flag indicating whether a document is new to the crawler that fetched it.
static final String	PREFIX

Method Summary

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Details

PREFIX

public static final String PREFIX

See Also:

• Constant Field Values

DEPTH

public static final String DEPTH

See Also:

• Constant Field Values

CHECKSUM_METADATA

public static final String CHECKSUM_METADATA

See Also:

• Constant Field Values

CHECKSUM_DOC

public static final String CHECKSUM_DOC

See Also:

• Constant Field Values

IS_DOC_NEW

public static final String IS_DOC_NEW

Boolean flag indicating whether a document is new to the crawler that fetched it. That is, a URL cache from a previous run exists and the document was not found in that cache. If the crawler runs for the first time or its URL cache has been deleted, this flag will always be true.

See Also:

• Constant Field Values

FETCHER

public static final String FETCHER

Qualified name of fetcher used to fetch a document.

See Also:

• Constant Field Values