Evaluate RESchemas

Operation

You can apply an evaluation operation comparing two RESchemas to calculate the annotation recall, precision and f-score. This will compare a RESchema taken as the gold standard (typically from a manually annotated corpus) and an RESchema to compare (typically from running an algorithm). To start the evaluation process, right click on the RESchema Datatype to be selected as gold standard and select "Evaluate -> NER Schema".

Select RESchema to compare

A GUI will be launched to choose the RESchema Datatype (in blue) to be compared with the gold standard selected on clipboard.

NOTES: Only RESchema with the same Normalization process present in the Gold Standard will appear

Result

An information pop-up with the annotation recall, precision and f-score measures will appear after the evaluation process.