Package com.norconex.crawler.fs.fetch.impl.hdfs

Class HdfsFetcherConfig

java.lang.Object

com.norconex.crawler.core.fetch.BaseFetcherConfig

com.norconex.crawler.fs.fetch.impl.BaseAuthNioFetcherConfig

com.norconex.crawler.fs.fetch.impl.hdfs.HdfsFetcherConfig

public class HdfsFetcherConfig
extends BaseAuthNioFetcherConfig

Configuration for HdfsFetcher.

Constructor Summary

Constructors

Constructor	Description
HdfsFetcherConfig()

Method Summary

Modifier and Type	Method	Description
protected boolean	canEqual(Object other)
boolean	equals(Object o)
HdfsAuthMethod	getAuthMethod()	Authentication method.
KerberosConfig	getKerberosConfig()	Kerberos/SPNEGO configuration.
int	hashCode()
HdfsFetcherConfig	setAuthMethod(HdfsAuthMethod authMethod)	Authentication method.
HdfsFetcherConfig	setKerberosConfig(KerberosConfig kerberosConfig)	Kerberos/SPNEGO configuration.
String	toString()

Methods inherited from class com.norconex.crawler.fs.fetch.impl.BaseAuthNioFetcherConfig

getCredentials, getDomain, setDomain

Methods inherited from class com.norconex.crawler.core.fetch.BaseFetcherConfig

getReferenceFilters, setReferenceFilters

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Details

HdfsFetcherConfig

public HdfsFetcherConfig()

Method Details

getAuthMethod

public HdfsAuthMethod getAuthMethod()

Authentication method. Defaults to HdfsAuthMethod.SIMPLE (no real authentication, the configured username if any is sent as the user.name query parameter). Use HdfsAuthMethod.KERBEROS for clusters with hadoop.security.authentication=kerberos, and set setKerberosConfig(KerberosConfig) accordingly.

getKerberosConfig

public KerberosConfig getKerberosConfig()

Kerberos/SPNEGO configuration. Required when getAuthMethod() is HdfsAuthMethod.KERBEROS.

setAuthMethod

public HdfsFetcherConfig setAuthMethod(HdfsAuthMethod authMethod)

Authentication method. Defaults to HdfsAuthMethod.SIMPLE (no real authentication, the configured username if any is sent as the user.name query parameter). Use HdfsAuthMethod.KERBEROS for clusters with hadoop.security.authentication=kerberos, and set setKerberosConfig(KerberosConfig) accordingly.

Returns:

this.

setKerberosConfig

public HdfsFetcherConfig setKerberosConfig(KerberosConfig kerberosConfig)

Kerberos/SPNEGO configuration. Required when getAuthMethod() is HdfsAuthMethod.KERBEROS.

Returns:

this.

equals

public boolean equals(Object o)

Overrides:

equals in class BaseAuthNioFetcherConfig

canEqual

protected boolean canEqual(Object other)

Overrides:

canEqual in class BaseAuthNioFetcherConfig

hashCode

public int hashCode()

Overrides:

hashCode in class BaseAuthNioFetcherConfig

toString

public String toString()

Overrides:

toString in class BaseAuthNioFetcherConfig