A Boolean that specifies whether to treat all punctuation characters as part of a word token, rather than treating them as word boundaries. Setting this parameter to True
is equivalent to setting the TangibleCharacters
parameter to all punctuation characters.
This parameter has no effect when MatchWholeWord
is set to False
.
For more information on using TokenWithPunctuation
to configure all punctuation marks as tangible characters, refer to IDOL Expert.
Note: If you specify the TokenWithPunctuation
action, this overrides any settings you make using the TokenWithPunctuation
configuration parameter.
Action: | EduceFromFile, EduceFromText, RedactFromFile, RedactFromText |
---|---|
Type: | Boolean |
Default: | False |
Example: | TokenWithPunctuation=True
|
See Also: | MatchWholeWord
TangibleCharacters |
|