Committers

Start here to configure output committers. The usage sample shows a single committer block and links to common implementations.

Usage

YAML

class: SqlCommitter
connectionUrl: string
createFieldSQL: string
createTableSQL: string
credentials:
  password: string
  passwordKey: {}
  username: string
driverClass: string
driverPath: string
fieldMappings: {}
fixFieldNames: false
fixFieldValues: false
multiValuesJoiner: string
primaryKey: string
properties:
  caseInsensitiveKeys: false
queue:
  class: FsQueue
  batchSize: 0
  commitLeftoversOnInit: false
  maxPerFolder: 0
  onCommitFailure: {}
restrictions:
  - {}
tableName: string
targetContentField: string

JSON

{
  "class": "SqlCommitter",
  "connectionUrl": "string",
  "createFieldSQL": "string",
  "createTableSQL": "string",
  "credentials": {
    "password": "string",
    "passwordKey": {},
    "username": "string"
  },
  "driverClass": "string",
  "driverPath": "string",
  "fieldMappings": {},
  "fixFieldNames": false,
  "fixFieldValues": false,
  "multiValuesJoiner": "string",
  "primaryKey": "string",
  "properties": {
    "caseInsensitiveKeys": false
  },
  "queue": {
    "class": "FsQueue",
    "batchSize": 0,
    "commitLeftoversOnInit": false,
    "maxPerFolder": 0,
    "onCommitFailure": {}
  },
  "restrictions": [
    {}
  ],
  "tableName": "string",
  "targetContentField": "string"
}

XML

<committer>
  <class>SqlCommitter</class>
  <connectionUrl>string</connectionUrl>
  <createFieldSQL>string</createFieldSQL>
  <createTableSQL>string</createTableSQL>
  <credentials/>
  <driverClass>string</driverClass>
  <driverPath>string</driverPath>
  <fieldMappings/>
  <fixFieldNames>false</fixFieldNames>
  <fixFieldValues>false</fixFieldValues>
  <multiValuesJoiner>string</multiValuesJoiner>
  <primaryKey>string</primaryKey>
  <properties/>
  <queue/>
  <restrictions/>
  <tableName>string</tableName>
  <targetContentField>string</targetContentField>
</committer>

Key Types

• Committer
• CommitterQueue
• SqlCommitter
• ElasticsearchCommitter