Namespace NOpenNLP.Tools.Cmdline.Tokenizer

Classes

DetokenEvaluationErrorListener

A default implementation of IEvaluationMonitor<T> that prints to an output stream.

DictionaryDetokenizerTool

SimpleTokenizerTool

TokenEvaluationErrorListener

A default implementation of IEvaluationMonitor<T> that prints to an output stream.

TokenizerConverterTool

TokenizerCrossValidatorTool

TokenizerMEEvaluatorTool

TokenizerMETool

TokenizerModelLoader

Loads a Tokenizer Model for the command line tools.

Note: Do not use this class, internal use only!

TokenizerTrainerTool