Class DefaultSDContextGenerator

Generate event contexts for maxent decisions for sentence detection.

public class DefaultSDContextGenerator : ISDContextGenerator

Inherited Members: object.Equals(object)

object.Equals(object, object)

object.GetHashCode()

object.GetType()

object.MemberwiseClone()

object.ReferenceEquals(object, object)

object.ToString()

Constructors

Creates a new ISDContextGenerator instance with no induced abbreviations.

public DefaultSDContextGenerator(char[] eosCharacters)

Creates a new ISDContextGenerator instance which uses the set of induced abbreviations.

public DefaultSDContextGenerator(ISet<string> inducedAbbreviations, char[] eosCharacters)

inducedAbbreviations ISet<string>: a ISet<T> of strings representing induced abbreviations in the training data. Example: "Mr."
eosCharacters char[]

String buffer for generating features.

protected readonly StringBuilder buf

List for holding features as they are generated.

protected readonly IList<string> collectFeats

Determines some of the features for the sentence detector and adds them to list features.

protected virtual void CollectFeatures(string prefix, string suffix, string previous, string next)

prefix string: String preceding the eos character in the eos token.
suffix string: String following the eos character in the eos token.
previous string: Space delimited token preceding token containing eos character.
next string: Space delimited token following token containing eos character.

Deprecated: Use CollectFeatures instead.

Determines some of the features for the sentence detector and adds them to list features.

protected virtual void CollectFeatures(string prefix, string suffix, string previous, string next, char? eosChar)

prefix string: String preceding the eos character in the eos token.
suffix string: String following the eos character in the eos token.
previous string: Space delimited token preceding token containing eos character.
next string: Space delimited token following token containing eos character.
eosChar char?: the EOS character been analyzed

Returns an array of contextual features for the potential sentence boundary at the specified position within the specified string buffer.

public virtual string[] GetContext(string sb, int position)

sb string
position int: An index into the specified string buffer when a sentence boundary may occur.

string[]: an array of contextual features for the potential sentence boundary at the specified position within the specified string buffer.