Class CharacterNgramFeatureGenerator

Namespace
NOpenNLP.Tools.Util.Featuregen
Assembly
NOpenNLP.Tools.dll

The CharacterNgramFeatureGenerator uses character ngrams to generate features about each token. The minimum and maximum length can be specified.

public class CharacterNgramFeatureGenerator : IAdaptiveFeatureGenerator
Inheritance
CharacterNgramFeatureGenerator
Implements
Inherited Members

Constructors

CharacterNgramFeatureGenerator()

Initializes the current instance with min 2 length and max 5 length of ngrams.

public CharacterNgramFeatureGenerator()

CharacterNgramFeatureGenerator(int, int)

The CharacterNgramFeatureGenerator uses character ngrams to generate features about each token. The minimum and maximum length can be specified.

public CharacterNgramFeatureGenerator(int minLength, int maxLength)

Parameters

minLength int
maxLength int

Methods

ClearAdaptiveData()

Informs the feature generator that the context of the adaptive data (typically a document) is no longer valid.

public virtual void ClearAdaptiveData()

CreateFeatures(IList<string>, string[], int, string[])

Adds the appropriate features for the token at the specified index with the specified array of previous outcomes to the specified list of features.

public virtual void CreateFeatures(IList<string> features, string[] tokens, int index, string[] preds)

Parameters

features IList<string>

The list of features to be added to.

tokens string[]

The tokens of the sentence or other text unit being processed.

index int

The index of the token which is currently being processed.

preds string[]

UpdateAdaptiveData(string[], string[])

Informs the feature generator that the specified tokens have been classified with the corresponding set of specified outcomes.

public virtual void UpdateAdaptiveData(string[] tokens, string[] outcomes)

Parameters

tokens string[]

The tokens of the sentence or other text unit which has been processed.

outcomes string[]

The outcomes associated with the specified tokens.