Namespace NOpenNLP.Tools.Sentdetect
Package related to identifying sentece boundries.
Namespaces
Classes
- DefaultEndOfSentenceScanner
Default implementation of the IEndOfSentenceScanner. It uses an character array with possible end of sentence chars to identify potential sentence endings.
- DefaultSDContextGenerator
Generate event contexts for maxent decisions for sentence detection.
- EmptyLinePreprocessorStream
Stream to to clean up empty lines for empty line separated document streams.
- Skips empty line at training data start
- Transforms multiple empty lines in a row into one
- Replaces white space lines with empty lines
- TODO: Terminates last document with empty line if it is missing
This stream should be used by the components that mark empty lines to mark document boundaries.
Do not use this class, internal use only!- Skips empty line at training data start
- NewlineSentenceDetector
The Newline Sentence Detector assumes that sentences are line delimited and recognizes one sentence per non-empty line.
- SDCrossValidator
A cross validator for the sentence detector.
- SentenceDetectorEvaluator
The SentenceDetectorEvaluator measures the performance of the given ISentenceDetector with the provided reference SentenceSamples.
- SentenceDetectorFactory
The factory that provides SentenceDetecor default implementations and resources
- SentenceDetectorME
A sentence detector for splitting up raw text into sentences.
A maximum entropy model is used to evaluate end-of-sentence characters in a string to determine if they signify the end of a sentence.
- SentenceModel
The SentenceModel is the model used by a learnable ISentenceDetector.
- SentenceSample
A SentenceSample contains a document with begin indexes of the individual sentences.
- SentenceSampleStream
This class is a stream filter which reads a sentence by line samples from a
Readerand converts them into SentenceSample objects. An empty line indicates the begin of a new document.
Interfaces
- IEndOfSentenceScanner
Scans Strings, StringBuffers, and char[] arrays for the offsets of sentence ending characters.
Implementations of this interface can use regular expressions, hand-coded DFAs, and other scanning techniques to locate end of sentence offsets.
- ISDContextGenerator
Interface for SentenceDetectorME context generators.
- ISentenceDetector
The interface for sentence detectors, which find the sentence boundaries in a text.