Evaluate RESchemas

Operation

You can apply an evaluation operation comparing two RESchemas to calculate the annotation recall, precision and f-score. This will compare a RESchema taken as the gold standard (typically from a manually annotated corpus) and an RESchema to compare (typically from running an algorithm). To start the evaluation process, right click on the RESchema Datatype to be selected as gold standard and select "Evaluate -> NER Schema".

Select RESchema to compare

A GUI will be launched to choose the RESchema Datatype (in blue) to be compared with the gold standard selected on clipboard.

NOTES: Only RESchema with the same Normalization process present in the Gold Standard will appear

Result

An NER schema evaluation report will appear after evaluation process with the annotation recall, precision and f-score measures.