Class TokenizerEvaluator

Namespace

NOpenNLP.Tools.Tokenize

Assembly

NOpenNLP.Tools.dll

The TokenizerEvaluator measures the performance of the given ITokenizer with the provided reference TokenSamples.

public class TokenizerEvaluator : Evaluator<TokenSample>

Inheritance

object

Evaluator<TokenSample>

TokenizerEvaluator

Inherited Members

Evaluator<TokenSample>.EvaluateSample(TokenSample)

Evaluator<TokenSample>.Evaluate(IObjectStream<TokenSample>)

object.Equals(object)

object.Equals(object, object)

object.GetHashCode()

object.GetType()

object.MemberwiseClone()

object.ReferenceEquals(object, object)

object.ToString()

Constructors

TokenizerEvaluator(ITokenizer, params ITokenizerEvaluationMonitor?[]?)

Initializes the current instance with the given ITokenizer.

public TokenizerEvaluator(ITokenizer tokenizer, params ITokenizerEvaluationMonitor?[]? listeners)

Parameters

tokenizer ITokenizer

the ITokenizer to evaluate.

listeners ITokenizerEvaluationMonitor[]

evaluation sample listeners

Properties

FMeasure

public virtual FMeasure FMeasure { get; }

Property Value

FMeasure

Methods

ProcessSample(TokenSample)

Evaluates the given reference sample object.

The implementation has to update the score after every invocation.

protected override TokenSample ProcessSample(TokenSample reference)

Parameters

reference TokenSample

the reference sample.

Returns

TokenSample

the predicted sample

See Also

Evaluator<T>

ITokenizer

TokenSample