Package com.norconex.committer.apachekafka

Class ApacheKafkaCommitter

java.lang.Object

com.norconex.committer.core.AbstractCommitter<ApacheKafkaCommitterConfig>

com.norconex.committer.core.batch.AbstractBatchCommitter<ApacheKafkaCommitterConfig>

com.norconex.committer.apachekafka.ApacheKafkaCommitter

All Implemented Interfaces:

BatchConsumer, Committer, Configurable<ApacheKafkaCommitterConfig>, AutoCloseable

public class ApacheKafkaCommitter
extends AbstractBatchCommitter<ApacheKafkaCommitterConfig>

Commits documents to Kafka via it's Producer API

Topic Creation

By default topics are assumed to already exist. You can optionally have them created when not already present with ApacheKafkaCommitterConfig.setCreateTopic(boolean).

Author:

Harinder Hanjan

Field Summary

Fields inherited from interface com.norconex.commons.lang.config.Configurable

PROPERTY

Constructor Summary

Constructors

Constructor	Description
ApacheKafkaCommitter()

Method Summary

Modifier and Type	Method	Description
protected boolean	canEqual(Object other)
protected void	closeBatchCommitter()	Subclasses can perform additional closing logic by overriding this method.
protected void	commitBatch(Iterator<CommitterRequest> it)	Commits the supplied batch.
boolean	equals(Object o)
ApacheKafkaCommitterConfig	getConfiguration()
int	hashCode()
protected void	initBatchCommitter()	Subclasses can perform additional initialization by overriding this method.
String	toString()

Methods inherited from class com.norconex.committer.core.batch.AbstractBatchCommitter

consume, doClean, doClose, doDelete, doInit, doUpsert, getInitializedQueue

Methods inherited from class com.norconex.committer.core.AbstractCommitter

accept, applyFieldMappings, clean, close, delete, fireDebug, fireDebug, fireError, fireError, fireInfo, fireInfo, getCommitterContext, init, upsert

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Details

ApacheKafkaCommitter

public ApacheKafkaCommitter()

Method Details

initBatchCommitter

protected void initBatchCommitter()
                           throws CommitterException

Description copied from class: AbstractBatchCommitter

Subclasses can perform additional initialization by overriding this method. Default implementation does nothing. The committer context and committer queue will be already initialized when invoking AbstractCommitter.getCommitterContext() and AbstractBatchCommitter.getInitializedQueue(), respectively.

Overrides:

initBatchCommitter in class AbstractBatchCommitter<ApacheKafkaCommitterConfig>

Throws:

CommitterException - error initializing

commitBatch

protected void commitBatch(Iterator<CommitterRequest> it)
                    throws CommitterException

Description copied from class: AbstractBatchCommitter

Commits the supplied batch.

Specified by:

commitBatch in class AbstractBatchCommitter<ApacheKafkaCommitterConfig>

Parameters:

it - the batch to commit

Throws:

CommitterException - could not commit the batch

closeBatchCommitter

protected void closeBatchCommitter()
                            throws CommitterException

Description copied from class: AbstractBatchCommitter

Subclasses can perform additional closing logic by overriding this method. Default implementation does nothing.

Overrides:

closeBatchCommitter in class AbstractBatchCommitter<ApacheKafkaCommitterConfig>

Throws:

CommitterException - error closing committer

equals

public boolean equals(Object o)

Overrides:

equals in class AbstractBatchCommitter<ApacheKafkaCommitterConfig>

canEqual

protected boolean canEqual(Object other)

Overrides:

canEqual in class AbstractBatchCommitter<ApacheKafkaCommitterConfig>

hashCode

public int hashCode()

Overrides:

hashCode in class AbstractBatchCommitter<ApacheKafkaCommitterConfig>

toString

public String toString()

Overrides:

toString in class AbstractBatchCommitter<ApacheKafkaCommitterConfig>

getConfiguration

public ApacheKafkaCommitterConfig getConfiguration()