Difference between revisions of "Evaluate RESchemas"
RRodrigues (talk | contribs) |
RRodrigues (talk | contribs) |
||
| Line 24: | Line 24: | ||
== Result == | == Result == | ||
| − | An | + | An NER schema evaluation report will appear after evaluation process with the annotation recall, precision and f-score measures. |
[[File:RESchema Evaluate Result.png|center|500px]] | [[File:RESchema Evaluate Result.png|center|500px]] | ||
Latest revision as of 14:08, 15 January 2015
Operation
You can apply an evaluation operation comparing two RESchemas to calculate the annotation recall, precision and f-score. This will compare a RESchema taken as the gold standard (typically from a manually annotated corpus) and an RESchema to compare (typically from running an algorithm). To start the evaluation process, right click on the RESchema Datatype to be selected as gold standard and select "Evaluate -> NER Schema".
Select RESchema to compare
A GUI will be launched to choose the RESchema Datatype (in blue) to be compared with the gold standard selected on clipboard.
NOTES: Only RESchema with the same Normalization process present in the Gold Standard will appear
Result
An NER schema evaluation report will appear after evaluation process with the annotation recall, precision and f-score measures.
