Class EvalitaNameSampleStream

Namespace

NOpenNLP.Tools.Formats

Assembly

NOpenNLP.Tools.dll

Parser for the Italian NER training files of the Evalita 2007 and 2009 NER shared tasks.

The data does not contain article boundaries, adaptive data will be cleared for every sentence.

Named Entities are annotated in the IOB2 format (as used in CoNLL 2002 shared task)

The Named Entity tag consists of two parts:

1. The IOB2 tag: 'B' (for 'begin') denotes the first token of a Named Entity, I (for 'inside') is used for all other tokens in a Named Entity, and 'O' (for 'outside') is used for all other words;
2. The Entity type tag: PER (for Person), ORG (for Organization), GPE (for Geo-Political Entity), or LOC (for Location).

Each file consists of four columns separated by a blank, containing respectively the token, the Elsnet PoS-tag, the Adige news story to which the token belongs, and the Named Entity tag.

Data can be found on this web site:
http://www.evalita.it

Note: Do not use this class, internal use only!

public class EvalitaNameSampleStream : ObjectStreamBase<NameSample?>, IObjectStream<NameSample?>, IDisposable

Inheritance

object

ObjectStreamBase<NameSample>

EvalitaNameSampleStream

Implements

IObjectStream<NameSample>

IDisposable

Inherited Members

ObjectStreamBase<NameSample>.Dispose()

object.Equals(object)

object.Equals(object, object)

object.GetHashCode()

object.GetType()

object.MemberwiseClone()

object.ReferenceEquals(object, object)

object.ToString()

Constructors

EvalitaNameSampleStream(Language, IInputStreamFactory, int)

public EvalitaNameSampleStream(EvalitaNameSampleStream.Language lang, IInputStreamFactory @in, int types)

Parameters

lang EvalitaNameSampleStream.Language

in IInputStreamFactory

types int

Exceptions

IOException

if there is an error during reading

EvalitaNameSampleStream(Language, IObjectStream<string?>, int)

public EvalitaNameSampleStream(EvalitaNameSampleStream.Language lang, IObjectStream<string?> lineStream, int types)

Parameters

lang EvalitaNameSampleStream.Language

lineStream IObjectStream<string>

types int

Fields

DocStart

public const string DocStart = "-DOCSTART-"

Field Value

string

GenerateGpeEntities

public const int GenerateGpeEntities = 8

Field Value

int

GenerateLocationEntities

public const int GenerateLocationEntities = 4

Field Value

int

GenerateOrganizationEntities

public const int GenerateOrganizationEntities = 2

Field Value

int

GeneratePersonEntities

public const int GeneratePersonEntities = 1

Field Value

int

Methods

Dispose(bool)

Releases the resources from this object stream.

protected override void Dispose(bool disposing)

Parameters

disposing bool

Read()

Returns the next object. Calling this method repeatedly until it returns null will return each object from the underlying source exactly once.

public override NameSample? Read()

Returns

NameSample

the next object or null to signal that the stream is exhausted

Exceptions

IOException

if there is an error during reading

IOException

if there is an error during reading

Reset()

Repositions the stream at the beginning and the previously seen object sequence will be repeated exactly. This method can be used to re-read the stream if multiple passes over the objects are required.

The implementation of this method is optional.

public override void Reset()

Exceptions

IOException

if there is an error during resetting the stream

NotSupportedException

if reset is not supported on this stream

IOException

if there is an error during resetting the stream