LogCommitter
Logs data associated with every document crawled without saving them.
Notes
Logs all document data to the application log without saving the documents to any persistent store. Useful for debugging and development to inspect what documents and fields the crawler produces. Not intended for production use.
Usage
- YAML
- JSON
- XML
class: LogCommitter
fieldMappings: {}
fieldMatcher:
ignoreCase: false
ignoreDiacritic: false
matchEmpty: false
method: BASIC
negateMatches: false
partial: false
pattern: string
replaceAll: false
trim: false
ignoreContent: false
logLevel: TRACE
restrictions:
- fieldMatcher: {}
valueMatcher: {}
{
"class": "LogCommitter",
"fieldMappings": {},
"fieldMatcher": {
"ignoreCase": false,
"ignoreDiacritic": false,
"matchEmpty": false,
"method": "BASIC",
"negateMatches": false,
"partial": false,
"pattern": "string",
"replaceAll": false,
"trim": false
},
"ignoreContent": false,
"logLevel": "TRACE",
"restrictions": [
{
"fieldMatcher": {},
"valueMatcher": {}
}
]
}
<logCommitter>
<class>LogCommitter</class>
<fieldMappings/>
<fieldMatcher>
<ignoreCase>false</ignoreCase>
<ignoreDiacritic>false</ignoreDiacritic>
<matchEmpty>false</matchEmpty>
<method>BASIC</method>
<negateMatches>false</negateMatches>
<partial>false</partial>
<pattern>string</pattern>
<replaceAll>false</replaceAll>
<trim>false</trim>
</fieldMatcher>
<ignoreContent>false</ignoreContent>
<logLevel>TRACE</logLevel>
<restrictions>
<restriction>
<fieldMatcher/>
<valueMatcher/>
</restriction>
</restrictions>
</logCommitter>
Properties
| Property | Type | Required | Default |
|---|---|---|---|
fieldMappings | Record<string, string> | No | - |
fieldMatcher | TextMatcher | No | TextMatcher |
ignoreContent | boolean | No | false |
logLevel | enum | No | - |
restrictions | PropertyMatcher[] | No | - |
Property Details
fieldMappings
Mapping of source fields to target ones to be logged.
fieldMatcher
Log values of matching field names. Leave empty to log values from all fields.
ignoreContent
Do not log document content.
logLevel
The log level used when printing values.
Allowed Values
TRACEDEBUGINFOWARNERRORSTDOUTSTDERR
restrictions
Defines filter conditions that restrict which documents this committer processes. Documents not matching the restrictions are ignored by this committer.