Class JsonFileCommitter
java.lang.Object
com.norconex.committer.core.AbstractCommitter<JsonFileCommitterConfig>
com.norconex.committer.core.fs.AbstractFsCommitter<Writer,JsonFileCommitterConfig>
com.norconex.committer.core.fs.impl.JsonFileCommitter
- All Implemented Interfaces:
Committer,Configurable<JsonFileCommitterConfig>,AutoCloseable
Commits documents to JSON files. There are two kinds of entries representing document upserts and deletions.
The generated file entries are never updated. Sending a modified document with the same reference (typically unlikely) will create a new entry and won't modify any existing ones. You can think of the generated files as a set of commit instructions.
Generated JSON format:
[
{"upsert": {
"reference": "document reference, e.g., URL",
"metadata": {
"name": ["value"],
"anothername": [
"multivalue1",
"multivalue2"
],
"anyname": ["name-value is repeated as necessary"]
},
"content": "Document Content Goes here"
}},
{"upsert": {
// upsert is repeated as necessary
}},
{"delete": {
"reference": "document reference, e.g., URL",
"metadata": {
"name": ["value"],
"anothername": [
"multivalue1",
"multivalue2"
],
"anyname": ["name-value is repeated as necessary"]
}
}},
{"delete": {
// delete is repeated as necessary
}}
]
-
Field Summary
Fields inherited from interface com.norconex.commons.lang.config.Configurable
PROPERTY -
Constructor Summary
Constructors -
Method Summary
Modifier and TypeMethodDescriptionprotected booleanprotected voidcloseDocWriter(Writer writer) protected WritercreateDocWriter(Writer writer) booleanprotected StringinthashCode()toString()protected voidwriteDelete(Writer writer, DeleteRequest deleteRequest) protected voidwriteUpsert(Writer writer, UpsertRequest upsertRequest) Methods inherited from class com.norconex.committer.core.fs.AbstractFsCommitter
doClean, doClose, doDelete, doInit, doUpsert, getResolvedDirectoryMethods inherited from class com.norconex.committer.core.AbstractCommitter
accept, applyFieldMappings, clean, close, delete, fireDebug, fireDebug, fireError, fireError, fireInfo, fireInfo, getCommitterContext, init, upsert
-
Constructor Details
-
JsonFileCommitter
public JsonFileCommitter()
-
-
Method Details
-
getFileExtension
- Specified by:
getFileExtensionin classAbstractFsCommitter<Writer,JsonFileCommitterConfig>
-
createDocWriter
- Specified by:
createDocWriterin classAbstractFsCommitter<Writer,JsonFileCommitterConfig> - Throws:
IOException
-
writeUpsert
- Specified by:
writeUpsertin classAbstractFsCommitter<Writer,JsonFileCommitterConfig> - Throws:
IOException
-
writeDelete
- Specified by:
writeDeletein classAbstractFsCommitter<Writer,JsonFileCommitterConfig> - Throws:
IOException
-
closeDocWriter
- Specified by:
closeDocWriterin classAbstractFsCommitter<Writer,JsonFileCommitterConfig> - Throws:
IOException
-
equals
- Overrides:
equalsin classAbstractFsCommitter<Writer,JsonFileCommitterConfig>
-
canEqual
- Overrides:
canEqualin classAbstractFsCommitter<Writer,JsonFileCommitterConfig>
-
hashCode
public int hashCode()- Overrides:
hashCodein classAbstractFsCommitter<Writer,JsonFileCommitterConfig>
-
toString
- Overrides:
toStringin classAbstractFsCommitter<Writer,JsonFileCommitterConfig>
-
getConfiguration
-