Enum DetokenizationOperationType

Namespace

NOpenNLP.Tools.Tokenize

Assembly

NOpenNLP.Tools.dll

Specifies in which direction a token should be moved when detokenizing.

public enum DetokenizationOperationType

Extension Methods

DetokenizationOperationTypeExtensions.ToOperationString(DetokenizationOperationType)

Fields

MoveRight = 0

Attaches the token to the token on the right side.

MoveLeft = 1

Attaches the token to the token on the left side.

MoveBoth = 2

Attaches the token to the token on the left and right sides.

RightLeftMatching = 3

Attaches the token token to the right token on first occurrence, and to the token on the left side on the second occurrence.

Remarks

NOpenNLP: upstream declares this enum nested inside DetokenizationDictionary, as DetokenizationDictionary.Operation. A nested enum would have to be referred to by the same qualified name in C#, but the upstream name Operation is too general for a namespace-level type, so it is hoisted and renamed DetokenizationOperationType.