Difference between revisions of "Evaluate RESchemas"
Anote2Wiki (talk | contribs) |
RRodrigues (talk | contribs) |
||
| Line 27: | Line 27: | ||
| − | [[File:RESchema Evaluate Result.png|center| | + | [[File:RESchema Evaluate Result.png|center|500px]] |
Revision as of 14:04, 15 January 2015
Operation
You can apply an evaluation operation comparing two RESchemas to calculate the annotation recall, precision and f-score. This will compare a RESchema taken as the gold standard (typically from a manually annotated corpus) and an RESchema to compare (typically from running an algorithm). To start the evaluation process, right click on the RESchema Datatype to be selected as gold standard and select "Evaluate -> NER Schema".
Select RESchema to compare
A GUI will be launched to choose the RESchema Datatype (in blue) to be compared with the gold standard selected on clipboard.
NOTES: Only RESchema with the same Normalization process present in the Gold Standard will appear
Result
An information pop-up with the annotation recall, precision and f-score measures will appear after the evaluation process.
