Evaluate NERSchemas

From Anote2Wiki
Revision as of 12:25, 13 November 2014 by RRodrigues (talk | contribs)
Jump to: navigation, search

Operation

The user can apply a evaluation operation between two NERSchemas in order to calculate the annotation recall, precision and f-score between a NERSchema Gold Standard and a NERSchema to compare. To start the evaluation process right click on the NERSchema Datatype to be selected as NERSchema Gold Standard and select "Evaluate -> NER Schema".

NERSchema Evaluate.png

Select NERSchema to compare

A GUI will be launched to choose NERSchema Datatype (in blue) to be compared with the NERSchema Gold Standard selected on clipboard.

NERSchema Evaluate GUI.png


NOTES: Only will appear NERSchemas with the same Normalization process present in NERSchema Gold Standard.

Result

A information pop-up with the annotation recall, precision and f-score measures will appear after the evaluation process.

RESchema Evaluate Result.png